2021-08-21T14:52:23.166 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-21T14:52:23.168 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} --archive /home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350483 --name yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350483/orig.config.yaml 2021-08-21T14:52:23.203 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-08-21T14:52:23.253 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350483 branch: wip-yuri-master-8.20.21 description: rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} email: ceph-qa@ceph.io first_in_suite: false job_id: '6350483' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: '8.3' overrides: admin_socket: branch: wip-yuri-master-8.20.21 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - \(MON_DOWN\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-master-8.20.21 sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - osd.0 - osd.1 - osd.2 sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri-master-8.20.21 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_cae1ffd55a16af4627c36508fde05bf24312fad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 targets: smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaBMNBgUp3Two/W82w9kbWZ1RP/7zy6svRd/qPZPQ1Cx9iTbpp3Q+Go8IBvRAQen6bNKLduYggSeXcTxij0pvKH66ikMaYCg7mPCLClO7fR2lh9CadflchxSXOPLGJbaCoUxKWDh+yOBs12iEjAe4gI1u8ltHEKpFzw9oRFHBU+0kcN4pMn6/VVoBvkiiztUKwQlddkxBfaurPXv0EW1lUjgG3cF62hgpCTtEP1HCb7+S8kcACcz0mI4llkzNXStv/B0ff1aI6tw4RIMG4XB8C7CvVC+XSAy3Cc2vMP15D9XO8Be6dzJ2dvYLcmTjfsr0k/vroujmqbSlX4m30P3SqystBe83PuQ3rPGpUU2w0VTtixXlTi6eTg5q62vFm4ZktQGD5ck8Ac9Jm2m+Jg+FuSGU/xKJaRkwf82Cwesb/uQGUR7G8HV9HdRNFlekcscsIx3yNr3plAGUoqKOfApRWCHMysfELwaH+mywF5Apv2tx+LSkfN5gW8OeCzXf5ycE= tasks: - install: null - ceph: conf: osd: osd min pg log entries: 5 osd pg log trim min: 0 osd_fast_fail_on_connection_refused: false log-ignorelist: - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(OBJECT_DEGRADED\) - \(SLOW_OPS\) - slow request pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - osd_recovery: null teuthology_branch: master teuthology_sha1: 321319b12ea4ff9b63c7655015a3156de2c3b279 timestamp: 2021-08-21_14:21:15 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.30581 2021-08-21T14:52:23.254 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_cae1ffd55a16af4627c36508fde05bf24312fad6/qa; will attempt to use it 2021-08-21T14:52:23.255 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_cae1ffd55a16af4627c36508fde05bf24312fad6/qa/tasks 2021-08-21T14:52:23.255 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-08-21T14:52:23.257 INFO:teuthology.task.internal:Checking packages... 2021-08-21T14:52:23.279 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'cae1ffd55a16af4627c36508fde05bf24312fad6' 2021-08-21T14:52:23.279 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-08-21T14:52:23.280 INFO:teuthology.packaging:ref: None 2021-08-21T14:52:23.280 INFO:teuthology.packaging:tag: None 2021-08-21T14:52:23.281 INFO:teuthology.packaging:branch: wip-yuri-master-8.20.21 2021-08-21T14:52:23.281 INFO:teuthology.packaging:sha1: cae1ffd55a16af4627c36508fde05bf24312fad6 2021-08-21T14:52:23.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-master-8.20.21 2021-08-21T14:52:23.443 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-7135.gcae1ffd5 2021-08-21T14:52:23.444 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-08-21T14:52:23.456 INFO:teuthology.task.internal:no buildpackages task found 2021-08-21T14:52:23.456 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-08-21T14:52:23.471 INFO:teuthology.task.internal:Saving configuration 2021-08-21T14:52:23.483 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-08-21T14:52:23.495 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-08-21T14:52:23.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-08-21 14:47:29.423788', 'description': '/home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350483', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG1nmELRptwL4r1eFroIBfiKwMT1e6sOKne+ss98tDgT0yGzvgni/hdbpAkTBEMU3cm8rAYV+1s7csxb9nBG7TM=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi173.front.sepia.ceph.com'} 2021-08-21T14:52:23.512 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-08-21T14:52:23.524 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'] 2021-08-21T14:52:23.524 INFO:teuthology.run_tasks:Running task console_log... 2021-08-21T14:52:23.561 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f07b55a1b70>, signals=[15]) 2021-08-21T14:52:23.563 INFO:teuthology.run_tasks:Running task internal.connect... 2021-08-21T14:52:23.574 INFO:teuthology.task.internal:Opening connections... 2021-08-21T14:52:23.574 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2021-08-21T14:52:23.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-21T14:52:23.646 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-08-21T14:52:23.658 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2021-08-21T14:52:23.798 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2021-08-21T14:52:23.798 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2021-08-21T14:52:23.852 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Linux" 2021-08-21T14:52:23.852 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2021-08-21T14:52:23.853 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2021-08-21T14:52:23.853 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2021-08-21T14:52:23.853 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2021-08-21T14:52:23.853 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2021-08-21T14:52:23.854 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Linux 8" 2021-08-21T14:52:23.854 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2021-08-21T14:52:23.854 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-08-21T14:52:23.854 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2021-08-21T14:52:23.855 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-08-21T14:52:23.855 INFO:teuthology.orchestra.run.smithi173.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-08-21T14:52:23.855 INFO:teuthology.orchestra.run.smithi173.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-08-21T14:52:23.856 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-08-21T14:52:23.872 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-08-21T14:52:23.887 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-08-21T14:52:23.899 INFO:teuthology.task.internal:Checking for old test directory... 2021-08-21T14:52:23.900 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2021-08-21T14:52:23.914 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-08-21T14:52:23.924 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-08-21T14:52:23.925 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2021-08-21T14:52:23.971 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-08-21T14:52:24.000 INFO:teuthology.run_tasks:Running task kernel... 2021-08-21T14:52:24.020 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}} 2021-08-21T14:52:24.020 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-08-21T14:52:24.021 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2021-08-21T14:52:24.035 INFO:teuthology.orchestra.run.smithi173.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-08-21T14:52:24.035 INFO:teuthology.task.kernel:Running kernel on smithi173: 4.18.0-305.10.2.el8_4.x86_64 2021-08-21T14:52:24.036 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum install -y kernel 2021-08-21T14:52:26.132 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - AppStream 41 MB/s | 8.8 MB 00:00 2021-08-21T14:52:27.649 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - Base 44 MB/s | 5.6 MB 00:00 2021-08-21T14:52:28.497 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - Extras 137 kB/s | 10 kB 00:00 2021-08-21T14:52:29.430 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Linux 8 - AppStream 10 MB/s | 8.8 MB 00:00 2021-08-21T14:52:32.841 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Linux 8 - BaseOS 2.7 MB/s | 5.6 MB 00:02 2021-08-21T14:52:33.812 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Linux 8 - Extras 56 kB/s | 10 kB 00:00 2021-08-21T14:52:33.965 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - PowerTools 24 MB/s | 2.3 MB 00:00 2021-08-21T14:52:36.536 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2021-08-21T14:52:37.270 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 15 MB/s | 10 MB 00:00 2021-08-21T14:52:39.459 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2021-08-21T14:52:41.429 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-08-21T14:52:41.430 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-08-21T14:52:41.733 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T14:52:41.733 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T14:52:41.734 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T14:52:41.734 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T14:52:41.734 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T14:52:41.734 INFO:teuthology.orchestra.run.smithi173.stdout: kernel x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 5.9 M 2021-08-21T14:52:41.735 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T14:52:41.735 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 36 M 2021-08-21T14:52:41.735 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules x86_64 4.18.0-305.12.1.el8_4 CentOS-Base 28 M 2021-08-21T14:52:41.735 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T14:52:41.735 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T14:52:41.736 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T14:52:41.736 INFO:teuthology.orchestra.run.smithi173.stdout:Install 3 Packages 2021-08-21T14:52:41.736 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T14:52:41.737 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 70 M 2021-08-21T14:52:41.737 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 88 M 2021-08-21T14:52:41.737 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T14:52:41.868 INFO:teuthology.orchestra.run.smithi173.stdout:(1/3): kernel-4.18.0-305.12.1.el8_4.x86_64.rpm 45 MB/s | 5.9 MB 00:00 2021-08-21T14:52:42.567 INFO:teuthology.orchestra.run.smithi173.stdout:(2/3): kernel-core-4.18.0-305.12.1.el8_4.x86_64 43 MB/s | 36 MB 00:00 2021-08-21T14:52:42.804 INFO:teuthology.orchestra.run.smithi173.stdout:(3/3): kernel-modules-4.18.0-305.12.1.el8_4.x86 26 MB/s | 28 MB 00:01 2021-08-21T14:52:42.807 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T14:52:42.808 INFO:teuthology.orchestra.run.smithi173.stdout:Total 65 MB/s | 70 MB 00:01 2021-08-21T14:52:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T14:52:43.247 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T14:52:43.248 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T14:52:44.408 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T14:52:44.424 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T14:52:46.848 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T14:52:47.344 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-core-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T14:52:50.551 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T14:52:50.893 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T14:52:53.861 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T14:52:54.071 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T14:53:14.798 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T14:53:15.105 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T14:53:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-4.18.0-305.12.1.el8_4.x86_64 1/3 2021-08-21T14:53:15.106 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-core-4.18.0-305.12.1.el8_4.x86_64 2/3 2021-08-21T14:53:15.492 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-4.18.0-305.12.1.el8_4.x86_64 3/3 2021-08-21T14:53:15.493 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T14:53:15.493 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T14:53:15.494 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:53:15.494 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:53:15.495 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:53:15.495 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T14:53:15.496 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T14:53:15.714 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel --last | head -n 1 2021-08-21T14:53:15.858 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-4.18.0-305.12.1.el8_4.x86_64 Sat 21 Aug 2021 02:52:53 PM UTC 2021-08-21T14:53:15.860 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:53:15.861 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:53:15.861 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-08-21T14:53:15.861 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-08-21T14:53:15.862 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-08-21T14:53:15.862 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2021-08-21T14:53:15.862 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel --last | head -n 1 2021-08-21T14:53:15.994 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-4.18.0-305.12.1.el8_4.x86_64 Sat 21 Aug 2021 02:52:53 PM UTC 2021-08-21T14:53:15.996 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:53:15.997 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2021-08-21T14:53:16.027 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2021-08-21T14:53:16.027 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2021-08-21T14:53:16.027 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.02 2021-08-21T14:53:16.027 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 90.el8 2021-08-21T14:53:16.028 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2021-08-21T14:53:16.028 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Wed 11 Aug 2021 06:38:04 PM UTC 2021-08-21T14:53:16.028 INFO:teuthology.orchestra.run.smithi173.stdout:Group : System Environment/Base 2021-08-21T14:53:16.028 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 9197207 2021-08-21T14:53:16.028 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2021-08-21T14:53:16.029 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-08-21T14:53:16.029 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-08-21T14:53:16.029 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-08-21T14:53:16.029 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : kbuilder.bsys.centos.org 2021-08-21T14:53:16.030 INFO:teuthology.orchestra.run.smithi173.stdout:Relocations : (not relocatable) 2021-08-21T14:53:16.030 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : CentOS BuildSystem 2021-08-21T14:53:16.030 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2021-08-21T14:53:16.030 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2021-08-21T14:53:16.030 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2021-08-21T14:53:16.031 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2021-08-21T14:53:16.031 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T14:53:16.031 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-08-21T14:53:16.031 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2021-08-21T14:53:16.032 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2021-08-21T14:53:16.032 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2021-08-21T14:53:16.032 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T14:53:16.032 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2021-08-21T14:53:16.033 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-08-21T14:53:16.033 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:53:16.034 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-08-21T14:53:17.569 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2021-08-21T14:53:19.727 INFO:teuthology.orchestra.run.smithi173.stderr:done 2021-08-21T14:53:19.728 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2021-08-21T14:53:19.768 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.Y5SN19uymo 2021-08-21T14:53:19.769 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Y5SN19uymo 2021-08-21T14:53:19.851 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.Y5SN19uymo 2021-08-21T14:53:19.999 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.Y5SN19uymo is 6KB 2021-08-21T14:53:20.048 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.Y5SN19uymo 2021-08-21T14:53:20.062 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2021-08-21T14:53:20.136 INFO:teuthology.orchestra.run.smithi173.stdout:ecc66dffcd264e5181894e69c53ff13c-0-rescue.conf 2021-08-21T14:53:20.136 INFO:teuthology.orchestra.run.smithi173.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-240.el8.x86_64.conf 2021-08-21T14:53:20.137 INFO:teuthology.orchestra.run.smithi173.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.10.2.el8_4.x86_64.conf 2021-08-21T14:53:20.137 INFO:teuthology.orchestra.run.smithi173.stdout:ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.12.1.el8_4.x86_64.conf 2021-08-21T14:53:20.138 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default ecc66dffcd264e5181894e69c53ff13c-4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:53:20.290 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2021-08-21T14:53:50.322 INFO:teuthology.misc:Re-opening connections... 2021-08-21T14:53:50.323 INFO:teuthology.misc:trying to connect to ubuntu@smithi173.front.sepia.ceph.com 2021-08-21T14:53:50.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-21T14:53:50.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-21T14:54:50.383 DEBUG:teuthology.orchestra.remote:timed out 2021-08-21T14:54:50.385 DEBUG:teuthology.misc:waited 60.06228828430176 2021-08-21T14:54:51.386 INFO:teuthology.misc:trying to connect to ubuntu@smithi173.front.sepia.ceph.com 2021-08-21T14:54:51.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-21T14:54:51.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-21T14:54:54.131 DEBUG:teuthology.orchestra.run.smithi173:> true 2021-08-21T14:54:54.469 DEBUG:teuthology.misc:waited 64.1458067893982 2021-08-21T14:54:55.471 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-08-21T14:54:55.471 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-305.12.1.el8_4.x86_64"... 2021-08-21T14:54:55.472 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2021-08-21T14:54:55.489 INFO:teuthology.orchestra.run.smithi173.stdout:4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:54:55.490 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.12.1.el8_4.x86_64 vs 4.18.0-305.12.1.el8_4.x86_64 2021-08-21T14:54:55.490 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-08-21T14:54:55.491 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-08-21T14:54:56.491 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-08-21T14:54:56.492 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-08-21T14:54:56.565 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2021-08-21T14:54:56.595 INFO:teuthology.run_tasks:Running task internal.base... 2021-08-21T14:54:56.610 INFO:teuthology.task.internal:Creating test directory... 2021-08-21T14:54:56.611 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-08-21T14:54:56.627 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-08-21T14:54:56.637 INFO:teuthology.run_tasks:Running task internal.archive... 2021-08-21T14:54:56.653 INFO:teuthology.task.internal:Creating archive directory... 2021-08-21T14:54:56.654 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-08-21T14:54:56.706 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-08-21T14:54:56.718 INFO:teuthology.task.internal:Enabling coredump saving... 2021-08-21T14:54:56.718 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-08-21T14:54:56.773 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-08-21T14:54:56.783 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-08-21T14:54:56.785 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-08-21T14:54:56.795 INFO:teuthology.task.internal:Configuring sudo... 2021-08-21T14:54:56.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-08-21T14:54:56.850 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-08-21T14:54:56.864 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-08-21T14:54:56.865 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-08-21T14:54:56.905 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-08-21T14:54:56.981 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-08-21T14:54:57.043 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-08-21T14:54:57.120 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-08-21T14:54:57.164 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T14:54:57.165 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-08-21T14:54:57.247 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2021-08-21T14:54:57.375 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-08-21T14:54:57.661 INFO:teuthology.run_tasks:Running task internal.timer... 2021-08-21T14:54:57.669 INFO:teuthology.task.internal:Starting timer... 2021-08-21T14:54:57.670 INFO:teuthology.run_tasks:Running task pcp... 2021-08-21T14:54:57.684 INFO:teuthology.run_tasks:Running task selinux... 2021-08-21T14:54:57.694 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-08-21T14:54:57.694 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2021-08-21T14:54:57.745 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: [ OK ] 2021-08-21T14:54:57.747 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-08-21T14:54:57.749 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2021-08-21T14:54:57.810 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2021-08-21T14:54:57.810 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2021-08-21T14:54:57.811 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-08-21T14:54:57.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-08-21T14:54:57.875 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-08-21T14:54:57.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2021-08-21T14:54:57.939 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-08-21T14:54:57.949 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-08-21T14:54:57.950 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-08-21T14:54:57.970 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-08-21T14:54:57.972 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-08-21T14:54:58.332 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-08-21T14:54:59.117 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-08-21T14:55:01.963 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-08-21T14:55:01.985 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:01 +0000 (0:00:00.037) 0:00:00.037 ******* 2021-08-21T14:55:04.798 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi173.front.sepia.ceph.com] 2021-08-21T14:55:04.844 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:04 +0000 (0:00:02.858) 0:00:02.896 ******* 2021-08-21T14:55:05.171 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-08-21T14:55:05.173 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-08-21T14:55:05.192 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:05 +0000 (0:00:00.348) 0:00:03.245 ******* 2021-08-21T14:55:05.653 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-08-21T14:55:05.655 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-08-21T14:55:05.675 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:05 +0000 (0:00:00.482) 0:00:03.727 ******* 2021-08-21T14:55:05.734 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:05.766 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:05 +0000 (0:00:00.090) 0:00:03.818 ******* 2021-08-21T14:55:06.032 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-08-21T14:55:06.034 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-21T14:55:06.055 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:06 +0000 (0:00:00.289) 0:00:04.108 ******* 2021-08-21T14:55:06.934 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-08-21T14:55:06.936 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1629557706.0979178-29537-108918221302169/source", "state": "file", "uid": 0} 2021-08-21T14:55:06.955 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:06 +0000 (0:00:00.900) 0:00:05.008 ******* 2021-08-21T14:55:07.395 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-08-21T14:55:07.397 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-08-21T14:55:07.399 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-08-21T14:55:07.460 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-08-21T14:55:07.462 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-08-21T14:55:07.476 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Saturday 21 August 2021 14:55:07 +0000 (0:00:00.520) 0:00:05.529 ******* 2021-08-21T14:55:07.997 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] 2021-08-21T14:55:08.013 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Saturday 21 August 2021 14:55:08 +0000 (0:00:00.536) 0:00:06.066 ******* 2021-08-21T14:55:08.039 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-08-21T14:55:08.044 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-08-21T14:55:08.198 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:08 +0000 (0:00:00.184) 0:00:06.251 ******* 2021-08-21T14:55:08.816 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi173.front.sepia.ceph.com] 2021-08-21T14:55:08.866 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Saturday 21 August 2021 14:55:08 +0000 (0:00:00.668) 0:00:06.919 ******* 2021-08-21T14:55:09.495 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-08-21T14:55:09.496 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.202725", "end": "2021-08-21 14:55:09.469852", "rc": 0, "start": "2021-08-21 14:55:09.267127", "stderr": "", "stderr_lines": [], "stdout": "7f6ec18127eb11437e244122daa7109a4352270a", "stdout_lines": ["7f6ec18127eb11437e244122daa7109a4352270a"]} 2021-08-21T14:55:09.517 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:09 +0000 (0:00:00.650) 0:00:07.569 ******* 2021-08-21T14:55:09.719 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-08-21T14:55:09.721 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007825", "end": "2021-08-21 14:55:09.693563", "failed_when_result": false, "rc": 0, "start": "2021-08-21 14:55:09.685738", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-08-21T14:55:09.741 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:09 +0000 (0:00:00.223) 0:00:07.793 ******* 2021-08-21T14:55:09.819 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-08-21T14:55:09.820 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:09.840 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:09 +0000 (0:00:00.099) 0:00:07.893 ******* 2021-08-21T14:55:09.908 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:09.930 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:09 +0000 (0:00:00.088) 0:00:07.981 ******* 2021-08-21T14:55:09.997 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:10.020 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:10 +0000 (0:00:00.090) 0:00:08.072 ******* 2021-08-21T14:55:10.087 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:10.109 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:10 +0000 (0:00:00.089) 0:00:08.161 ******* 2021-08-21T14:55:10.176 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-08-21T14:55:10.178 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:10.198 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:10 +0000 (0:00:00.089) 0:00:08.251 ******* 2021-08-21T14:55:10.420 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-08-21T14:55:10.422 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-21T14:55:10.443 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:10 +0000 (0:00:00.244) 0:00:08.495 ******* 2021-08-21T14:55:10.727 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-08-21T14:55:10.728 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-08-21T14:55:10.914 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-08-21T14:55:11.111 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-08-21T14:55:11.308 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-08-21T14:55:11.495 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-08-21T14:55:11.693 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-08-21T14:55:11.880 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-08-21T14:55:12.080 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-08-21T14:55:12.267 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-08-21T14:55:12.474 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-08-21T14:55:12.672 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-08-21T14:55:12.858 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-08-21T14:55:13.056 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-08-21T14:55:13.252 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-08-21T14:55:13.443 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-08-21T14:55:13.641 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-08-21T14:55:13.828 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-08-21T14:55:14.026 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-08-21T14:55:14.224 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-08-21T14:55:14.411 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-08-21T14:55:14.607 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-08-21T14:55:14.804 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-08-21T14:55:15.001 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-08-21T14:55:15.189 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-08-21T14:55:15.385 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-08-21T14:55:15.583 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-08-21T14:55:15.771 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-08-21T14:55:15.968 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-08-21T14:55:16.157 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-08-21T14:55:16.346 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-08-21T14:55:16.545 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-08-21T14:55:16.744 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-08-21T14:55:16.943 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-08-21T14:55:17.136 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-08-21T14:55:17.324 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-08-21T14:55:17.534 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-08-21T14:55:17.723 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-08-21T14:55:17.910 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-08-21T14:55:18.108 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-08-21T14:55:18.294 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-08-21T14:55:18.492 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-08-21T14:55:18.690 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-08-21T14:55:18.886 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-08-21T14:55:19.075 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-08-21T14:55:19.271 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-08-21T14:55:19.459 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-08-21T14:55:19.656 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-08-21T14:55:19.847 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-08-21T14:55:20.044 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-08-21T14:55:20.241 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-08-21T14:55:20.438 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-08-21T14:55:20.624 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-08-21T14:55:20.824 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-08-21T14:55:21.023 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-08-21T14:55:21.220 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-08-21T14:55:21.407 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-08-21T14:55:21.605 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-08-21T14:55:21.795 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-08-21T14:55:21.993 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-08-21T14:55:22.182 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-08-21T14:55:22.379 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-08-21T14:55:22.581 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-08-21T14:55:22.775 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-08-21T14:55:22.972 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-08-21T14:55:23.160 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-08-21T14:55:23.370 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-08-21T14:55:23.569 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-08-21T14:55:23.756 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-08-21T14:55:23.952 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-08-21T14:55:24.161 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-08-21T14:55:24.358 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-08-21T14:55:24.556 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-08-21T14:55:24.742 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-08-21T14:55:24.939 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-08-21T14:55:25.136 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-08-21T14:55:25.324 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-08-21T14:55:25.521 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-08-21T14:55:25.714 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-08-21T14:55:25.911 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-08-21T14:55:26.109 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-08-21T14:55:26.305 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-08-21T14:55:26.492 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-08-21T14:55:26.702 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-08-21T14:55:26.889 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-08-21T14:55:27.086 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-08-21T14:55:27.284 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-08-21T14:55:27.481 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-08-21T14:55:27.678 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-08-21T14:55:27.866 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-08-21T14:55:28.062 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-08-21T14:55:28.262 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-08-21T14:55:28.450 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-08-21T14:55:28.650 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-08-21T14:55:28.848 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-08-21T14:55:29.036 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-08-21T14:55:29.236 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-08-21T14:55:29.426 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-08-21T14:55:29.626 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-08-21T14:55:29.823 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-08-21T14:55:30.025 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-08-21T14:55:30.225 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-08-21T14:55:30.425 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-08-21T14:55:30.623 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-08-21T14:55:30.822 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-08-21T14:55:31.009 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-08-21T14:55:31.206 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-08-21T14:55:31.405 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-08-21T14:55:31.592 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-08-21T14:55:31.796 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-08-21T14:55:32.006 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-08-21T14:55:32.235 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-08-21T14:55:32.462 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-08-21T14:55:32.675 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-08-21T14:55:32.898 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-08-21T14:55:33.102 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-08-21T14:55:33.304 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-08-21T14:55:33.519 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-08-21T14:55:33.719 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-08-21T14:55:33.916 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-08-21T14:55:34.128 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-08-21T14:55:34.317 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-08-21T14:55:34.527 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-08-21T14:55:34.726 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-08-21T14:55:34.935 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-08-21T14:55:35.129 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-08-21T14:55:35.338 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-08-21T14:55:35.535 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-08-21T14:55:35.735 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-08-21T14:55:35.935 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-08-21T14:55:36.122 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-08-21T14:55:36.350 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-08-21T14:55:36.548 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-08-21T14:55:36.746 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-08-21T14:55:36.944 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-08-21T14:55:37.152 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-08-21T14:55:37.350 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-08-21T14:55:37.549 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-08-21T14:55:37.746 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-08-21T14:55:37.950 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-08-21T14:55:38.165 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-08-21T14:55:38.353 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-08-21T14:55:38.554 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-08-21T14:55:38.754 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-08-21T14:55:38.965 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-08-21T14:55:39.175 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-08-21T14:55:39.385 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-08-21T14:55:39.594 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-08-21T14:55:39.806 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-08-21T14:55:40.007 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-08-21T14:55:40.206 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-08-21T14:55:40.417 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-08-21T14:55:40.614 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-08-21T14:55:40.813 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-08-21T14:55:41.011 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-08-21T14:55:41.208 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-08-21T14:55:42.887 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-08-21T14:55:44.695 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-08-21T14:55:46.259 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-08-21T14:55:46.416 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:46 +0000 (0:00:35.973) 0:00:44.468 ******* 2021-08-21T14:55:46.505 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-08-21T14:55:46.527 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:46 +0000 (0:00:00.110) 0:00:44.579 ******* 2021-08-21T14:55:46.617 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-08-21T14:55:46.619 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-08-21T14:55:46.621 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-08-21T14:55:46.623 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-08-21T14:55:46.624 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-08-21T14:55:46.626 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99 2021-08-21T14:55:46.627 INFO:teuthology.task.ansible.out:bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-08-21T14:55:46.628 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-08-21T14:55:46.630 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-08-21T14:55:46.632 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-08-21T14:55:46.634 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-08-21T14:55:46.635 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-08-21T14:55:46.637 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-08-21T14:55:46.639 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0 2021-08-21T14:55:46.639 INFO:teuthology.task.ansible.out:fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-08-21T14:55:46.641 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-08-21T14:55:46.643 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4" 2021-08-21T14:55:46.644 INFO:teuthology.task.ansible.out:}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}]}, "changed": false} 2021-08-21T14:55:46.666 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:46 +0000 (0:00:00.139) 0:00:44.718 ******* 2021-08-21T14:55:47.532 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-08-21T14:55:47.533 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"after": "7f6ec18127eb11437e244122daa7109a4352270a", "attempts": 1, "before": "7f6ec18127eb11437e244122daa7109a4352270a", "changed": false, "remote_url_changed": false} 2021-08-21T14:55:47.555 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:55:47 +0000 (0:00:00.888) 0:00:45.607 ******* 2021-08-21T14:55:47.882 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-08-21T14:55:47.884 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-08-21T14:55:48.090 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-08-21T14:55:48.299 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-08-21T14:55:48.518 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-08-21T14:55:48.520 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-08-21T14:55:48.736 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-08-21T14:55:48.945 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-08-21T14:55:48.946 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-08-21T14:55:49.152 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-08-21T14:55:49.381 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-08-21T14:55:49.579 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-08-21T14:55:49.590 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:49.797 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-08-21T14:55:49.799 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-08-21T14:55:50.005 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-08-21T14:55:50.006 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-08-21T14:55:50.015 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:50.018 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:55:50.244 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-08-21T14:55:50.451 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-08-21T14:55:50.453 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-08-21T14:55:50.679 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-08-21T14:55:50.886 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-08-21T14:55:50.888 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-08-21T14:55:51.093 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-08-21T14:55:51.301 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-08-21T14:55:51.507 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-08-21T14:55:51.704 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-08-21T14:55:51.706 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-08-21T14:55:51.912 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-08-21T14:55:51.914 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-08-21T14:55:52.121 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-08-21T14:55:52.328 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-08-21T14:55:52.536 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2021-08-21T14:55:52.537 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-08-21T14:55:52.743 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-08-21T14:55:52.942 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-08-21T14:55:53.149 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-08-21T14:55:53.357 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-08-21T14:55:53.565 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-08-21T14:55:53.774 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-08-21T14:55:53.775 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-08-21T14:55:53.983 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-08-21T14:55:54.180 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-08-21T14:55:54.387 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-08-21T14:55:54.595 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-08-21T14:55:54.795 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-08-21T14:55:55.003 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-08-21T14:55:55.210 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-08-21T14:55:55.408 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-08-21T14:55:55.616 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-08-21T14:55:55.618 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-08-21T14:55:55.824 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-08-21T14:55:55.826 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-08-21T14:55:56.024 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-08-21T14:55:56.233 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-08-21T14:55:56.430 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-08-21T14:55:56.638 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2021-08-21T14:55:56.640 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-08-21T14:55:56.845 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-08-21T14:55:56.847 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-08-21T14:55:56.849 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-08-21T14:55:57.053 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-08-21T14:55:57.251 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-08-21T14:55:57.459 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-08-21T14:55:57.661 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-08-21T14:55:57.859 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-08-21T14:55:58.066 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-08-21T14:55:58.068 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-08-21T14:55:58.273 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-08-21T14:55:58.479 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-08-21T14:55:58.676 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-08-21T14:55:58.677 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-08-21T14:55:58.893 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-08-21T14:55:59.100 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-08-21T14:55:59.317 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-08-21T14:55:59.319 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-08-21T14:55:59.524 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-08-21T14:55:59.730 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-08-21T14:55:59.936 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-08-21T14:56:00.142 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-08-21T14:56:00.350 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-08-21T14:56:00.557 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-08-21T14:56:00.755 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-08-21T14:56:00.962 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-08-21T14:56:01.158 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-08-21T14:56:01.375 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-08-21T14:56:01.572 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-08-21T14:56:01.779 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-08-21T14:56:01.988 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-08-21T14:56:02.185 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-08-21T14:56:02.392 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-08-21T14:56:02.599 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-08-21T14:56:02.806 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-08-21T14:56:03.014 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-08-21T14:56:03.221 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-08-21T14:56:03.428 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-08-21T14:56:03.635 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-08-21T14:56:03.637 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-08-21T14:56:03.832 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-08-21T14:56:04.040 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-08-21T14:56:04.243 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-08-21T14:56:04.453 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-08-21T14:56:04.650 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-08-21T14:56:04.652 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-08-21T14:56:04.859 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-08-21T14:56:04.861 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-08-21T14:56:05.068 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-08-21T14:56:05.265 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-08-21T14:56:05.484 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-08-21T14:56:05.692 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-08-21T14:56:05.901 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-08-21T14:56:06.109 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-08-21T14:56:06.318 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-08-21T14:56:06.525 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-08-21T14:56:06.527 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-08-21T14:56:06.732 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-08-21T14:56:06.931 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-08-21T14:56:07.140 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-08-21T14:56:07.338 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-08-21T14:56:07.546 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-08-21T14:56:07.755 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-08-21T14:56:07.964 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-08-21T14:56:07.966 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-08-21T14:56:08.162 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-08-21T14:56:08.382 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-08-21T14:56:08.589 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-08-21T14:56:08.787 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-08-21T14:56:09.006 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-08-21T14:56:09.209 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-08-21T14:56:09.421 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-08-21T14:56:09.628 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-08-21T14:56:09.836 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-08-21T14:56:10.046 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-08-21T14:56:10.245 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-08-21T14:56:10.457 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-08-21T14:56:10.664 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-08-21T14:56:10.871 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-08-21T14:56:11.069 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-08-21T14:56:11.288 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-08-21T14:56:11.486 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-08-21T14:56:11.696 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-08-21T14:56:11.909 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-08-21T14:56:11.911 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-08-21T14:56:12.109 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-08-21T14:56:12.321 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-08-21T14:56:12.535 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-08-21T14:56:12.748 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-08-21T14:56:12.956 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-08-21T14:56:13.156 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-08-21T14:56:13.366 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-08-21T14:56:13.575 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-08-21T14:56:13.775 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-08-21T14:56:13.983 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-08-21T14:56:14.193 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-08-21T14:56:14.401 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-08-21T14:56:14.610 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-08-21T14:56:14.818 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-08-21T14:56:15.028 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-08-21T14:56:15.237 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-08-21T14:56:15.446 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2021-08-21T14:56:15.448 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-08-21T14:56:15.655 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-08-21T14:56:15.855 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-08-21T14:56:16.066 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-08-21T14:56:16.280 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-08-21T14:56:16.491 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-08-21T14:56:16.698 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-08-21T14:56:16.909 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-08-21T14:56:17.113 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-08-21T14:56:17.314 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-08-21T14:56:17.556 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-08-21T14:56:17.759 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-08-21T14:56:17.960 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-08-21T14:56:18.164 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-08-21T14:56:18.368 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-08-21T14:56:18.579 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-08-21T14:56:18.781 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-08-21T14:56:18.988 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-08-21T14:56:19.200 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-08-21T14:56:19.398 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-08-21T14:56:19.610 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-08-21T14:56:19.818 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-08-21T14:56:19.913 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:19 +0000 (0:00:32.358) 0:01:17.965 ******* 2021-08-21T14:56:20.026 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.037 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.039 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.050 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-08-21T14:56:20.052 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.063 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.074 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.076 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.279 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-08-21T14:56:20.300 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.323 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.505 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-08-21T14:56:20.717 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-08-21T14:56:20.731 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.740 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.742 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.752 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.769 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.775 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.787 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.798 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.799 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.809 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.821 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.823 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.832 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.834 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.843 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.855 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.866 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.877 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.879 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.889 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.901 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.914 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.936 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.946 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.948 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.958 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.960 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.969 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.980 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.991 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:20.993 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.003 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.014 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.026 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.037 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.048 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.050 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.068 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.071 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.082 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.093 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.095 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.108 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.127 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.131 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.133 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.145 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.155 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.168 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.179 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.190 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.193 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.202 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.213 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.214 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.226 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.236 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.238 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.248 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.260 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.262 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.272 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.283 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.294 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.307 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.316 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.328 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.339 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.350 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.362 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.374 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.385 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.397 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.408 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.421 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.433 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.442 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.445 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.457 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.468 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.485 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.487 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.497 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.499 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.519 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.521 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.535 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.559 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.561 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.571 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.574 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.583 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.587 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.595 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.606 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.608 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.619 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.623 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.631 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.642 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.652 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.654 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.666 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.676 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.681 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.739 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:21 +0000 (0:00:01.825) 0:01:19.791 ******* 2021-08-21T14:56:21.803 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-08-21T14:56:21.805 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:21.825 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:21 +0000 (0:00:00.085) 0:01:19.877 ******* 2021-08-21T14:56:22.104 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-08-21T14:56:22.106 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-08-21T14:56:22.300 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-08-21T14:56:22.489 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-08-21T14:56:22.681 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-08-21T14:56:22.871 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-08-21T14:56:23.074 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-08-21T14:56:23.260 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-08-21T14:56:23.448 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-08-21T14:56:23.640 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-08-21T14:56:23.837 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-08-21T14:56:24.024 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-08-21T14:56:24.218 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-08-21T14:56:24.416 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-08-21T14:56:24.604 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-08-21T14:56:24.808 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-08-21T14:56:24.995 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-08-21T14:56:25.184 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-08-21T14:56:25.373 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-08-21T14:56:25.564 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-08-21T14:56:25.764 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-08-21T14:56:25.952 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-08-21T14:56:26.144 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-08-21T14:56:26.343 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-08-21T14:56:26.530 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-08-21T14:56:26.728 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-08-21T14:56:26.916 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-08-21T14:56:27.103 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-08-21T14:56:27.294 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-08-21T14:56:27.483 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-08-21T14:56:27.680 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-08-21T14:56:27.870 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-08-21T14:56:28.067 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-08-21T14:56:28.250 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-08-21T14:56:28.443 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-08-21T14:56:28.628 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-08-21T14:56:28.830 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-08-21T14:56:29.011 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-08-21T14:56:29.199 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-08-21T14:56:29.398 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-08-21T14:56:29.586 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-08-21T14:56:29.784 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-08-21T14:56:29.972 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-08-21T14:56:30.163 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-08-21T14:56:30.362 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-08-21T14:56:30.561 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-08-21T14:56:30.753 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-08-21T14:56:30.942 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-08-21T14:56:31.130 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-08-21T14:56:31.320 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-08-21T14:56:31.379 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:31 +0000 (0:00:09.551) 0:01:29.428 ******* 2021-08-21T14:56:31.930 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-08-21T14:56:31.932 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "checksum": "39e5632aabd93a7648a3940c07007a14afe2d320", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "1f362c6963bf1f0d83c5c22328e42c02", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1629557791.474874-6381-155428140020346/source", "state": "file", "uid": 0} 2021-08-21T14:56:31.952 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:31 +0000 (0:00:00.576) 0:01:30.004 ******* 2021-08-21T14:56:32.020 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-08-21T14:56:32.022 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => { "msg": "Host smithi173.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-08-21T14:56:32.043 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:32 +0000 (0:00:00.090) 0:01:30.095 ******* 2021-08-21T14:56:32.122 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-08-21T14:56:32.124 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-08-21T14:56:32.145 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:32 +0000 (0:00:00.102) 0:01:30.198 ******* 2021-08-21T14:56:32.215 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-08-21T14:56:32.217 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:32.237 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:32 +0000 (0:00:00.091) 0:01:30.289 ******* 2021-08-21T14:56:32.550 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-08-21T14:56:32.553 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.079896", "end": "2021-08-21 14:56:32.527246", "rc": 0, "start": "2021-08-21 14:56:32.447350", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-08-21T14:56:32.582 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:32 +0000 (0:00:00.344) 0:01:30.634 ******* 2021-08-21T14:56:32.663 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:32.686 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:32 +0000 (0:00:00.103) 0:01:30.738 ******* 2021-08-21T14:56:32.755 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:32.778 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:32 +0000 (0:00:00.092) 0:01:30.831 ******* 2021-08-21T14:56:32.847 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-08-21T14:56:32.849 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:32.870 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:32 +0000 (0:00:00.091) 0:01:30.923 ******* 2021-08-21T14:56:32.961 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:32.984 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:32 +0000 (0:00:00.113) 0:01:31.036 ******* 2021-08-21T14:56:33.054 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:33.079 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.094) 0:01:31.130 ******* 2021-08-21T14:56:33.146 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:33.169 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.090) 0:01:31.221 ******* 2021-08-21T14:56:33.250 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-08-21T14:56:33.252 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi173.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-21T14:56:33.273 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.104) 0:01:31.325 ******* 2021-08-21T14:56:33.363 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-08-21T14:56:33.364 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:33.394 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.114) 0:01:31.440 ******* 2021-08-21T14:56:33.459 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-08-21T14:56:33.461 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:33.483 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.095) 0:01:31.535 ******* 2021-08-21T14:56:33.557 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:33.579 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.094) 0:01:31.629 ******* 2021-08-21T14:56:33.647 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi173.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-21T14:56:33.670 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.092) 0:01:31.722 ******* 2021-08-21T14:56:33.739 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-08-21T14:56:33.740 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:33.761 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.091) 0:01:31.813 ******* 2021-08-21T14:56:33.840 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi173.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-21T14:56:33.861 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.100) 0:01:31.914 ******* 2021-08-21T14:56:33.930 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:33.955 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:33 +0000 (0:00:00.090) 0:01:32.005 ******* 2021-08-21T14:56:34.032 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-08-21T14:56:34.034 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.056 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.103) 0:01:32.108 ******* 2021-08-21T14:56:34.127 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-08-21T14:56:34.128 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.150 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.092) 0:01:32.201 ******* 2021-08-21T14:56:34.218 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-08-21T14:56:34.227 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.244 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.095) 0:01:32.296 ******* 2021-08-21T14:56:34.323 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-08-21T14:56:34.325 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-21T14:56:34.347 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.102) 0:01:32.399 ******* 2021-08-21T14:56:34.416 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-08-21T14:56:34.418 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.446 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.099) 0:01:32.499 ******* 2021-08-21T14:56:34.530 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-08-21T14:56:34.532 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.552 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.105) 0:01:32.605 ******* 2021-08-21T14:56:34.620 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-08-21T14:56:34.622 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.643 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.091) 0:01:32.696 ******* 2021-08-21T14:56:34.713 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-08-21T14:56:34.714 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.735 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.091) 0:01:32.787 ******* 2021-08-21T14:56:34.804 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-08-21T14:56:34.806 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.826 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.091) 0:01:32.879 ******* 2021-08-21T14:56:34.895 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-08-21T14:56:34.897 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:34.917 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:34 +0000 (0:00:00.090) 0:01:32.969 ******* 2021-08-21T14:56:34.996 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-08-21T14:56:34.997 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-08-21T14:56:35.018 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:35 +0000 (0:00:00.100) 0:01:33.070 ******* 2021-08-21T14:56:35.086 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-08-21T14:56:35.088 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:35.109 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:35 +0000 (0:00:00.090) 0:01:33.161 ******* 2021-08-21T14:56:35.178 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-08-21T14:56:35.180 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:35.202 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:35 +0000 (0:00:00.092) 0:01:33.253 ******* 2021-08-21T14:56:35.479 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-08-21T14:56:35.481 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-21T14:56:35.501 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:35 +0000 (0:00:00.300) 0:01:33.554 ******* 2021-08-21T14:56:36.266 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi173.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-08-21T14:56:36.706 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-08-21T14:56:36.730 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:36 +0000 (0:00:01.228) 0:01:34.782 ******* 2021-08-21T14:56:37.245 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-08-21T14:56:37.248 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-08-21T14:56:37.688 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-08-21T14:56:37.712 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:37 +0000 (0:00:00.982) 0:01:35.765 ******* 2021-08-21T14:56:37.792 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:37.814 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:37 +0000 (0:00:00.101) 0:01:35.866 ******* 2021-08-21T14:56:37.882 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-08-21T14:56:37.884 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:37.910 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:37 +0000 (0:00:00.096) 0:01:35.962 ******* 2021-08-21T14:56:37.980 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.003 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:38 +0000 (0:00:00.093) 0:01:36.056 ******* 2021-08-21T14:56:38.071 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-08-21T14:56:38.073 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.095 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:38 +0000 (0:00:00.091) 0:01:36.147 ******* 2021-08-21T14:56:38.181 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** skipping: [smithi173.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.188 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.190 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.214 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:38 +0000 (0:00:00.119) 0:01:36.266 ******* 2021-08-21T14:56:38.282 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-08-21T14:56:38.284 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.304 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:38 +0000 (0:00:00.090) 0:01:36.357 ******* 2021-08-21T14:56:38.374 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.396 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:38 +0000 (0:00:00.091) 0:01:36.449 ******* 2021-08-21T14:56:38.457 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.478 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:38 +0000 (0:00:00.081) 0:01:36.531 ******* 2021-08-21T14:56:38.538 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-08-21T14:56:38.540 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.560 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:38 +0000 (0:00:00.081) 0:01:36.612 ******* 2021-08-21T14:56:38.618 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-08-21T14:56:38.620 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:38.640 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:38 +0000 (0:00:00.080) 0:01:36.692 ******* 2021-08-21T14:56:39.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-08-21T14:56:39.524 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.690395", "end": "2021-08-21 14:56:39.500333", "rc": 0, "start": "2021-08-21 14:56:38.809938", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:56:39.546 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:39 +0000 (0:00:00.905) 0:01:37.598 ******* 2021-08-21T14:56:43.158 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-08-21T14:56:43.159 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-21T14:56:43.180 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:43 +0000 (0:00:03.634) 0:01:41.232 ******* 2021-08-21T14:56:43.248 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-08-21T14:56:43.250 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:43.271 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:43 +0000 (0:00:00.091) 0:01:41.324 ******* 2021-08-21T14:56:43.342 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:43.365 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:43 +0000 (0:00:00.093) 0:01:41.417 ******* 2021-08-21T14:56:43.433 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-08-21T14:56:43.434 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:43.455 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:43 +0000 (0:00:00.090) 0:01:41.507 ******* 2021-08-21T14:56:43.544 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-08-21T14:56:43.545 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:43.566 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:43 +0000 (0:00:00.110) 0:01:41.618 ******* 2021-08-21T14:56:44.077 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-08-21T14:56:44.179 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:44 +0000 (0:00:00.532) 0:01:42.150 ******* 2021-08-21T14:56:45.685 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-08-21T14:56:45.686 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-21T14:56:45.707 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:45 +0000 (0:00:01.609) 0:01:43.759 ******* 2021-08-21T14:56:46.238 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi173.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-08-21T14:56:46.671 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-08-21T14:56:47.093 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-08-21T14:56:47.117 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:47 +0000 (0:00:01.409) 0:01:45.169 ******* 2021-08-21T14:56:47.310 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-08-21T14:56:47.312 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-21T14:56:47.334 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:47 +0000 (0:00:00.216) 0:01:45.386 ******* 2021-08-21T14:56:47.829 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-08-21T14:56:47.832 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-08-21T14:56:48.252 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-08-21T14:56:48.663 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-08-21T14:56:48.687 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:48 +0000 (0:00:01.353) 0:01:46.740 ******* 2021-08-21T14:56:48.760 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:48.785 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:48 +0000 (0:00:00.096) 0:01:46.837 ******* 2021-08-21T14:56:48.868 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-08-21T14:56:48.888 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:48 +0000 (0:00:00.103) 0:01:46.940 ******* 2021-08-21T14:56:49.127 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi173.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-08-21T14:56:49.148 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:49 +0000 (0:00:00.260) 0:01:47.201 ******* 2021-08-21T14:56:49.242 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi173.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:49.265 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:49.296 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:49.308 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:49.340 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:49 +0000 (0:00:00.191) 0:01:47.392 ******* 2021-08-21T14:56:50.968 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-21T14:56:50.996 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:50 +0000 (0:00:01.655) 0:01:49.048 ******* 2021-08-21T14:56:51.077 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-08-21T14:56:51.079 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:51.101 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:51 +0000 (0:00:00.104) 0:01:49.152 ******* 2021-08-21T14:56:51.618 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-08-21T14:56:51.620 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-08-21T14:56:51.641 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:51 +0000 (0:00:00.541) 0:01:49.694 ******* 2021-08-21T14:56:52.135 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-08-21T14:56:52.160 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:52 +0000 (0:00:00.517) 0:01:50.212 ******* 2021-08-21T14:56:52.239 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi173.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:52.250 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-08-21T14:56:52.272 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:52 +0000 (0:00:00.112) 0:01:50.324 ******* 2021-08-21T14:56:52.506 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-08-21T14:56:52.508 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-21T14:56:52.529 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:52 +0000 (0:00:00.257) 0:01:50.581 ******* 2021-08-21T14:56:52.808 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi173.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-08-21T14:56:52.834 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:52 +0000 (0:00:00.301) 0:01:50.882 ******* 2021-08-21T14:56:52.900 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-08-21T14:56:52.902 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:56:52.924 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:52 +0000 (0:00:00.093) 0:01:50.976 ******* 2021-08-21T14:56:53.443 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-08-21T14:56:53.445 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-08-21T14:56:53.472 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:53 +0000 (0:00:00.548) 0:01:51.525 ******* 2021-08-21T14:56:54.134 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-08-21T14:56:54.136 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1489", "ExecMainStartTimestamp": "Sat 2021-08-21 14:54:57 UTC", "ExecMainStartTimestampMonotonic": "20059012", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Sat 2021-08-21 14:54:57 UTC] ; stop_time=[n/a] ; pid=1489 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "L 2021-08-21T14:56:54.138 INFO:teuthology.task.ansible.out:imitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127246", "LimitNPROCSoft": "127246", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127246", "LimitSIGPENDINGSoft": "127246", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1489", "MemoryAccounting": "yes", "MemoryCurrent": "696320", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203593", "TimeoutStar 2021-08-21T14:56:54.139 INFO:teuthology.task.ansible.out:tUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Sat 2021-08-21 14:54:57 UTC", "WatchdogTimestampMonotonic": "20059064", "WatchdogUSec": "0"}} 2021-08-21T14:56:54.158 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:54 +0000 (0:00:00.685) 0:01:52.210 ******* 2021-08-21T14:56:54.385 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001797", "end": "2021-08-21 14:56:54.359848", "rc": 0, "start": "2021-08-21 14:56:54.358051", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-08-21T14:56:54.410 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:54 +0000 (0:00:00.251) 0:01:52.462 ******* 2021-08-21T14:56:56.009 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-21T14:56:56.031 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:56:56 +0000 (0:00:01.620) 0:01:54.083 ******* 2021-08-21T14:57:33.576 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-08-21T14:57:33.578 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-67.el8_4.1.noarch", "Installed: selinux-policy-3.14.3-67.el8_4.1.noarch", "Removed: selinux-policy-3.14.3-67.el8.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8.noarch"]} 2021-08-21T14:57:33.607 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:57:33 +0000 (0:00:37.574) 0:02:31.658 ******* 2021-08-21T14:57:34.334 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-08-21T14:57:34.355 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:57:34 +0000 (0:00:00.749) 0:02:32.407 ******* 2021-08-21T14:57:49.242 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-08-21T14:57:49.244 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:14.661917", "end": "2021-08-21 14:57:49.221692", "failed_when_result": false, "rc": 0, "start": "2021-08-21 14:57:34.559775", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-08-21T14:57:49.265 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:57:49 +0000 (0:00:14.909) 0:02:47.317 ******* 2021-08-21T14:57:49.770 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-08-21T14:57:49.772 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-08-21T14:57:49.794 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:57:49 +0000 (0:00:00.529) 0:02:47.846 ******* 2021-08-21T14:57:50.031 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-08-21T14:57:50.033 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010150", "end": "2021-08-21 14:57:50.009138", "rc": 0, "start": "2021-08-21 14:57:49.998988", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:57:50.054 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:57:50 +0000 (0:00:00.260) 0:02:48.107 ******* 2021-08-21T14:57:50.302 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-08-21T14:57:50.304 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010724", "end": "2021-08-21 14:57:50.280050", "rc": 0, "start": "2021-08-21 14:57:50.269326", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:57:50.324 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:57:50 +0000 (0:00:00.270) 0:02:48.377 ******* 2021-08-21T14:58:05.316 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-08-21T14:58:05.318 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:14.770933", "end": "2021-08-21 14:58:05.298228", "rc": 0, "start": "2021-08-21 14:57:50.527295", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:58:05.338 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:05 +0000 (0:00:15.013) 0:03:03.390 ******* 2021-08-21T14:58:05.577 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-08-21T14:58:05.597 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:05 +0000 (0:00:00.258) 0:03:03.649 ******* 2021-08-21T14:58:05.676 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-08-21T14:58:05.678 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-08-21T14:58:05.698 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:05 +0000 (0:00:00.101) 0:03:03.750 ******* 2021-08-21T14:58:05.777 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-08-21T14:58:05.778 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-08-21T14:58:05.800 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:05 +0000 (0:00:00.101) 0:03:03.852 ******* 2021-08-21T14:58:05.902 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-08-21T14:58:05.904 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "a 2021-08-21T14:58:05.906 INFO:teuthology.task.ansible.out:nsible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-08-21T14:58:05.927 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:05 +0000 (0:00:00.127) 0:03:03.980 ******* 2021-08-21T14:58:06.007 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-08-21T14:58:06.009 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-08-21T14:58:06.030 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:06 +0000 (0:00:00.102) 0:03:04.083 ******* 2021-08-21T14:58:06.214 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-08-21T14:58:06.216 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-08-21T14:58:06.237 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:06 +0000 (0:00:00.206) 0:03:04.289 ******* 2021-08-21T14:58:06.462 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-08-21T14:58:06.464 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-08-21T14:58:06.484 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:06 +0000 (0:00:00.246) 0:03:04.536 ******* 2021-08-21T14:58:06.555 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-08-21T14:58:06.558 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:06.580 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:06 +0000 (0:00:00.096) 0:03:04.632 ******* 2021-08-21T14:58:06.660 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-08-21T14:58:06.662 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:06.684 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:06 +0000 (0:00:00.103) 0:03:04.736 ******* 2021-08-21T14:58:06.940 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-08-21T14:58:06.942 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-08-21T14:58:06.967 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:06 +0000 (0:00:00.283) 0:03:05.020 ******* 2021-08-21T14:58:07.528 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-08-21T14:58:07.530 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-08-21T14:58:07.550 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:07 +0000 (0:00:00.582) 0:03:05.602 ******* 2021-08-21T14:58:07.618 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi173"}, "changed": false} 2021-08-21T14:58:07.640 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:07 +0000 (0:00:00.090) 0:03:05.693 ******* 2021-08-21T14:58:08.702 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi173.front.sepia.ceph.com", "ansible_hostname": "smithi173", "ansible_nodename": "smithi173"}, "changed": true, "name": "smithi173"} 2021-08-21T14:58:08.725 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:08 +0000 (0:00:01.084) 0:03:06.777 ******* 2021-08-21T14:58:09.211 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-08-21T14:58:09.213 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-08-21T14:58:09.243 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:09 +0000 (0:00:00.518) 0:03:07.295 ******* 2021-08-21T14:58:09.743 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-08-21T14:58:09.745 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-08-21T14:58:09.765 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:09 +0000 (0:00:00.522) 0:03:07.818 ******* 2021-08-21T14:58:10.334 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-08-21T14:58:10.336 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-08-21T14:58:10.356 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:10 +0000 (0:00:00.590) 0:03:08.409 ******* 2021-08-21T14:58:10.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-08-21T14:58:10.852 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-08-21T14:58:10.874 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:10 +0000 (0:00:00.517) 0:03:08.926 ******* 2021-08-21T14:58:11.110 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-08-21T14:58:11.166 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:11 +0000 (0:00:00.258) 0:03:09.184 ******* 2021-08-21T14:58:11.369 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-08-21T14:58:11.371 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-08-21T14:58:11.398 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:11 +0000 (0:00:00.266) 0:03:09.450 ******* 2021-08-21T14:58:11.658 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-08-21T14:58:11.660 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-08-21T14:58:11.681 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:11 +0000 (0:00:00.282) 0:03:09.733 ******* 2021-08-21T14:58:12.188 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-08-21T14:58:12.190 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-08-21T14:58:12.218 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:12 +0000 (0:00:00.537) 0:03:10.270 ******* 2021-08-21T14:58:12.748 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-08-21T14:58:12.750 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-08-21T14:58:12.777 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:12 +0000 (0:00:00.559) 0:03:10.829 ******* 2021-08-21T14:58:15.257 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-08-21T14:58:15.260 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.253428", "end": "2021-08-21 14:58:15.233226", "rc": 0, "start": "2021-08-21 14:58:12.979798", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:58:15.289 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:15 +0000 (0:00:02.512) 0:03:13.342 ******* 2021-08-21T14:58:15.368 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-08-21T14:58:15.370 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:15.390 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:15 +0000 (0:00:00.101) 0:03:13.443 ******* 2021-08-21T14:58:15.459 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:15.482 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:15 +0000 (0:00:00.091) 0:03:13.534 ******* 2021-08-21T14:58:15.560 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-08-21T14:58:15.562 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:15.587 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:15 +0000 (0:00:00.105) 0:03:13.639 ******* 2021-08-21T14:58:16.103 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-08-21T14:58:16.105 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-08-21T14:58:16.534 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-08-21T14:58:16.958 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-08-21T14:58:17.394 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-08-21T14:58:17.418 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:17 +0000 (0:00:01.831) 0:03:15.470 ******* 2021-08-21T14:58:18.084 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-08-21T14:58:18.086 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-08-21T14:58:18.108 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:18 +0000 (0:00:00.689) 0:03:16.160 ******* 2021-08-21T14:58:18.639 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi173.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-08-21T14:58:19.069 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-08-21T14:58:19.498 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-08-21T14:58:19.938 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-08-21T14:58:19.967 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:19 +0000 (0:00:01.858) 0:03:18.019 ******* 2021-08-21T14:58:20.476 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-08-21T14:58:20.478 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.272953", "end": "2021-08-21 14:58:20.450771", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-08-21 14:58:20.177818", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'comma 2021-08-21T14:58:20.480 INFO:teuthology.task.ansible.out:nd_warnings=False' in ansible.cfg to get rid of this message. 2021-08-21T14:58:20.500 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:20 +0000 (0:00:00.533) 0:03:18.552 ******* 2021-08-21T14:58:20.569 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-08-21T14:58:20.571 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:20.593 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:20 +0000 (0:00:00.092) 0:03:18.645 ******* 2021-08-21T14:58:20.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-08-21T14:58:20.690 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:20.698 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:20.722 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:20 +0000 (0:00:00.128) 0:03:18.774 ******* 2021-08-21T14:58:20.802 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:20.824 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:20 +0000 (0:00:00.102) 0:03:18.877 ******* 2021-08-21T14:58:21.054 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-08-21T14:58:21.080 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:21 +0000 (0:00:00.255) 0:03:19.132 ******* 2021-08-21T14:58:21.150 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-08-21T14:58:21.158 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:21.172 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:21 +0000 (0:00:00.092) 0:03:19.224 ******* 2021-08-21T14:58:21.250 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:21.273 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:21 +0000 (0:00:00.100) 0:03:19.325 ******* 2021-08-21T14:58:21.524 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi173.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006733", "end": "2021-08-21 14:58:21.499938", "msg": "non-zero return code", "rc": 1, "start": "2021-08-21 14:58:21.493205", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-08-21T14:58:21.547 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:21 +0000 (0:00:00.274) 0:03:19.599 ******* 2021-08-21T14:58:21.627 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-08-21T14:58:21.629 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:21.651 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:21 +0000 (0:00:00.104) 0:03:19.704 ******* 2021-08-21T14:58:25.924 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-08-21T14:58:25.926 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-08-21T14:58:25.947 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:25 +0000 (0:00:04.295) 0:03:23.999 ******* 2021-08-21T14:58:28.515 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-08-21T14:58:28.518 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-08-21T14:58:28.538 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:28 +0000 (0:00:02.590) 0:03:26.589 ******* 2021-08-21T14:58:35.843 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-img-15:4.2.0-48.module_el8.4.0+885+5e18b468.3.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-08-21T14:58:35.867 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:35 +0000 (0:00:07.330) 0:03:33.920 ******* 2021-08-21T14:58:35.961 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:35.990 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:35 +0000 (0:00:00.121) 0:03:34.041 ******* 2021-08-21T14:58:37.814 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-08-21T14:58:37.817 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-21T14:58:37.958 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:37 +0000 (0:00:01.969) 0:03:36.011 ******* 2021-08-21T14:58:39.556 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-21T14:58:39.584 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:39 +0000 (0:00:01.625) 0:03:37.636 ******* 2021-08-21T14:58:39.946 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-08-21T14:58:39.948 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity 2021-08-21T14:58:39.950 INFO:teuthology.task.ansible.out:", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127246", "LimitNPROCSoft": "127246", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127246", "LimitSIGPENDINGSoft": "127246", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203593", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-08-21T14:58:39.970 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:39 +0000 (0:00:00.385) 0:03:38.022 ******* 2021-08-21T14:58:40.316 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi173.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-08-21T14:58:40.338 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:40 +0000 (0:00:00.368) 0:03:38.390 ******* 2021-08-21T14:58:40.961 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-08-21T14:58:40.994 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:40 +0000 (0:00:00.654) 0:03:39.044 ******* 2021-08-21T14:58:41.069 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.093 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.100) 0:03:39.145 ******* 2021-08-21T14:58:41.161 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-08-21T14:58:41.163 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.206 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.090) 0:03:39.236 ******* 2021-08-21T14:58:41.263 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.285 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.102) 0:03:39.338 ******* 2021-08-21T14:58:41.356 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-08-21T14:58:41.359 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.380 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.094) 0:03:39.433 ******* 2021-08-21T14:58:41.451 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-08-21T14:58:41.453 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.478 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.097) 0:03:39.530 ******* 2021-08-21T14:58:41.550 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-08-21T14:58:41.552 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.573 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.095) 0:03:39.625 ******* 2021-08-21T14:58:41.643 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-08-21T14:58:41.668 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.093) 0:03:39.719 ******* 2021-08-21T14:58:41.751 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.774 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.107) 0:03:39.826 ******* 2021-08-21T14:58:41.843 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.866 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.091) 0:03:39.918 ******* 2021-08-21T14:58:41.946 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-08-21T14:58:41.948 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:41.972 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:41 +0000 (0:00:00.105) 0:03:40.023 ******* 2021-08-21T14:58:42.052 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-08-21T14:58:42.053 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.074 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.103) 0:03:40.127 ******* 2021-08-21T14:58:42.144 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-08-21T14:58:42.170 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.094) 0:03:40.222 ******* 2021-08-21T14:58:42.238 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-08-21T14:58:42.240 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.260 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.090) 0:03:40.312 ******* 2021-08-21T14:58:42.330 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-08-21T14:58:42.332 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.359 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.098) 0:03:40.411 ******* 2021-08-21T14:58:42.428 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.455 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.096) 0:03:40.507 ******* 2021-08-21T14:58:42.525 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-08-21T14:58:42.527 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.548 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.093) 0:03:40.600 ******* 2021-08-21T14:58:42.618 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.640 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.092) 0:03:40.692 ******* 2021-08-21T14:58:42.720 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.748 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.107) 0:03:40.800 ******* 2021-08-21T14:58:42.821 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-08-21T14:58:42.823 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.844 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.095) 0:03:40.896 ******* 2021-08-21T14:58:42.913 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-08-21T14:58:42.915 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:42.937 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:42 +0000 (0:00:00.093) 0:03:40.989 ******* 2021-08-21T14:58:43.020 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.045 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.107) 0:03:41.097 ******* 2021-08-21T14:58:43.118 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.138 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.093) 0:03:41.190 ******* 2021-08-21T14:58:43.229 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.255 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.117) 0:03:41.307 ******* 2021-08-21T14:58:43.334 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-08-21T14:58:43.336 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.360 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.104) 0:03:41.412 ******* 2021-08-21T14:58:43.440 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-08-21T14:58:43.441 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.462 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.102) 0:03:41.514 ******* 2021-08-21T14:58:43.533 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-08-21T14:58:43.535 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.557 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.093) 0:03:41.608 ******* 2021-08-21T14:58:43.642 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.665 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.105) 0:03:41.714 ******* 2021-08-21T14:58:43.730 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-08-21T14:58:43.732 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.754 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.091) 0:03:41.805 ******* 2021-08-21T14:58:43.813 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-08-21T14:58:43.816 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.844 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.090) 0:03:41.896 ******* 2021-08-21T14:58:43.915 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-08-21T14:58:43.916 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:43.940 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:43 +0000 (0:00:00.095) 0:03:41.992 ******* 2021-08-21T14:58:44.030 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.066 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.112) 0:03:42.104 ******* 2021-08-21T14:58:44.137 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.167 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.107) 0:03:42.212 ******* 2021-08-21T14:58:44.229 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-08-21T14:58:44.231 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.257 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.092) 0:03:42.305 ******* 2021-08-21T14:58:44.325 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-08-21T14:58:44.326 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.349 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.096) 0:03:42.401 ******* 2021-08-21T14:58:44.421 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-08-21T14:58:44.422 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.450 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.101) 0:03:42.502 ******* 2021-08-21T14:58:44.532 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.557 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.106) 0:03:42.609 ******* 2021-08-21T14:58:44.632 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.656 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.098) 0:03:42.707 ******* 2021-08-21T14:58:44.741 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.758 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.103) 0:03:42.811 ******* 2021-08-21T14:58:44.773 INFO:teuthology.task.ansible.out: 2021-08-21T14:58:44.830 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-08-21T14:58:44.832 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.854 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.094) 0:03:42.905 ******* 2021-08-21T14:58:44.923 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:44.945 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:44 +0000 (0:00:00.091) 0:03:42.997 ******* 2021-08-21T14:58:45.207 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-08-21T14:58:45.209 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-08-21T14:58:45.230 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:45 +0000 (0:00:00.285) 0:03:43.282 ******* 2021-08-21T14:58:45.511 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-21T14:58:45.534 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:45 +0000 (0:00:00.303) 0:03:43.586 ******* 2021-08-21T14:58:45.777 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-08-21T14:58:45.799 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:45 +0000 (0:00:00.265) 0:03:43.852 ******* 2021-08-21T14:58:45.880 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:45.905 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:45 +0000 (0:00:00.102) 0:03:43.954 ******* 2021-08-21T14:58:45.983 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.009 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:45 +0000 (0:00:00.104) 0:03:44.059 ******* 2021-08-21T14:58:46.079 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-08-21T14:58:46.081 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.101 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.094) 0:03:44.154 ******* 2021-08-21T14:58:46.171 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.199 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.098) 0:03:44.252 ******* 2021-08-21T14:58:46.270 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-08-21T14:58:46.271 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.292 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.092) 0:03:44.344 ******* 2021-08-21T14:58:46.364 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.387 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.095) 0:03:44.439 ******* 2021-08-21T14:58:46.456 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-08-21T14:58:46.458 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.480 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.092) 0:03:44.532 ******* 2021-08-21T14:58:46.550 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.573 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.092) 0:03:44.625 ******* 2021-08-21T14:58:46.642 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.663 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.090) 0:03:44.715 ******* 2021-08-21T14:58:46.733 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-08-21T14:58:46.735 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.756 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.093) 0:03:44.809 ******* 2021-08-21T14:58:46.836 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-08-21T14:58:46.838 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.860 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.103) 0:03:44.912 ******* 2021-08-21T14:58:46.935 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:46.960 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:46 +0000 (0:00:00.099) 0:03:45.012 ******* 2021-08-21T14:58:47.045 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-08-21T14:58:47.050 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.068 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.108) 0:03:45.120 ******* 2021-08-21T14:58:47.150 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.172 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.103) 0:03:45.224 ******* 2021-08-21T14:58:47.257 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.284 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.112) 0:03:45.336 ******* 2021-08-21T14:58:47.352 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.386 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.102) 0:03:45.439 ******* 2021-08-21T14:58:47.456 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-08-21T14:58:47.458 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.480 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.093) 0:03:45.532 ******* 2021-08-21T14:58:47.551 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-08-21T14:58:47.553 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.574 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.093) 0:03:45.626 ******* 2021-08-21T14:58:47.644 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.667 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.093) 0:03:45.720 ******* 2021-08-21T14:58:47.736 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-08-21T14:58:47.738 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.759 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.091) 0:03:45.811 ******* 2021-08-21T14:58:47.830 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.849 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.090) 0:03:45.902 ******* 2021-08-21T14:58:47.941 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-08-21T14:58:47.942 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:47.963 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:47 +0000 (0:00:00.113) 0:03:46.015 ******* 2021-08-21T14:58:48.042 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-21T14:58:48.044 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-08-21T14:58:48.065 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:48 +0000 (0:00:00.101) 0:03:46.117 ******* 2021-08-21T14:58:48.145 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-08-21T14:58:48.148 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.156 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-08-21T14:58:48.168 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.170 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.180 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.194 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.219 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:48 +0000 (0:00:00.154) 0:03:46.271 ******* 2021-08-21T14:58:48.221 INFO:teuthology.task.ansible.out: 2021-08-21T14:58:48.479 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-08-21T14:58:48.482 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004333", "end": "2021-08-21 14:58:48.451845", "rc": 0, "start": "2021-08-21 14:58:48.447512", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/virtualenv/bin/teuthology-lock"]} 2021-08-21T14:58:48.509 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:48 +0000 (0:00:00.290) 0:03:46.562 ******* 2021-08-21T14:58:48.591 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-08-21T14:58:48.593 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.616 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:48 +0000 (0:00:00.106) 0:03:46.668 ******* 2021-08-21T14:58:48.695 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.718 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:48 +0000 (0:00:00.102) 0:03:46.770 ******* 2021-08-21T14:58:48.800 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-08-21T14:58:48.802 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.828 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:48 +0000 (0:00:00.109) 0:03:46.880 ******* 2021-08-21T14:58:48.899 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-08-21T14:58:48.900 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:48.921 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:48 +0000 (0:00:00.093) 0:03:46.974 ******* 2021-08-21T14:58:50.516 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-21T14:58:50.540 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:50 +0000 (0:00:01.616) 0:03:48.591 ******* 2021-08-21T14:58:50.619 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-08-21T14:58:50.621 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930259275776, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114081, 'block_used': 12981027, 'inode_total': 61054976, 'inode_available': 60985860, 'inode_used': 69116, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114081, "block_size": 4096, "block_total": 240095108, "block_used": 12981027, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985860, "inode_total": 61054976, "inode_used": 69116, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930259275776, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}} 2021-08-21T14:58:50.643 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:50 +0000 (0:00:00.104) 0:03:48.695 ******* 2021-08-21T14:58:50.880 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-08-21T14:58:50.881 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005215", "end": "2021-08-21 14:58:50.856639", "rc": 0, "start": "2021-08-21 14:58:50.851424", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:58:50.903 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:50 +0000 (0:00:00.259) 0:03:48.955 ******* 2021-08-21T14:58:50.985 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi173.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930259275776, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114081, 'block_used': 12981027, 'inode_total': 61054976, 'inode_available': 60985860, 'inode_used': 69116, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114081, "block_size": 4096, "block_total": 240095108, "block_used": 12981027, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985860, "inode_total": 61054976, "inode_used": 69116, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930259275776, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:51.011 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:51 +0000 (0:00:00.107) 0:03:49.062 ******* 2021-08-21T14:58:51.090 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-08-21T14:58:51.111 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:51 +0000 (0:00:00.101) 0:03:49.163 ******* 2021-08-21T14:58:52.780 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-08-21T14:58:52.782 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QvkjK5kIcxqa5WSXTaBPnTf1r2ZBRqZi3'], 'uuids': ['dc1019e9-85a3-43b7-95bb-55a0c4f3ef2b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.404778", "end": "2021-08-21 14:58:52.743787", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QvkjK5kIcxqa5WSXTaBPnTf1r2ZBRqZi3"], "labels": [], "masters": [], "uuids": ["dc1019e9-85a3-43b7-95bb-55a0c4f3ef2b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:51.339009", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-21T14:58:54.031 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NmG8ll-xqSz-85u8-uMgi-IBGA-grTF-Bmb4Rc', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204019S400BGN', 'nvme-nvme.8086-50484654363230343031395334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.069394", "end": "2021-08-21 14:58:53.999345", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-NmG8ll-xqSz-85u8-uMgi-IBGA-grTF-Bmb4Rc", "nvme-INTEL_SSDPEDMD400G4_PHFT6204019S400BGN", "nvme-nvme.8086-50484654363230343031395334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:52.929951", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-08-21T14:58:54.033 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-21T14:58:55.253 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QtrVMF3Ex3Bod8eLDcTeNccZj8v35FDV7'], 'uuids': ['fe0ec41c-877e-4abe-8f81-43807fce508b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.043371", "end": "2021-08-21 14:58:55.227766", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QtrVMF3Ex3Bod8eLDcTeNccZj8v35FDV7"], "labels": [], "masters": [], "uuids": ["fe0ec41c-877e-4abe-8f81-43807fce508b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:54.184395", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-21T14:58:56.521 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QujLhdblSjMimQHbw3h4Udvt5ywyQxEMf'], 'uuids': ['0db160c0-4a32-4d75-9ff9-4201f105193f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.081759", "end": "2021-08-21 14:58:56.494252", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QujLhdblSjMimQHbw3h4Udvt5ywyQxEMf"], "labels": [], "masters": [], "uuids": ["0db160c0-4a32-4d75-9ff9-4201f105193f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:55.412493", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-21T14:58:57.765 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QTv3DdGcyy9SB225GpZxt33RorQItBPZ0'], 'uuids': ['84ef676b-b4f7-4407-9a7a-1f575f8b8364'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.048101", "end": "2021-08-21 14:58:57.728418", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QTv3DdGcyy9SB225GpZxt33RorQItBPZ0"], "labels": [], "masters": [], "uuids": ["84ef676b-b4f7-4407-9a7a-1f575f8b8364"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:56.680317", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi173.front.sepia.ceph.com] => 2021-08-21T14:58:57.768 INFO:teuthology.task.ansible.out:(item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM1Y', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM1Y', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM1Y', 'scsi-35000c50092935686', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XM1Y', 'wwn-0x5000c50092935686'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XM1Y', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092935686', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM1Y-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM1Y-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM1Y-part1', 'scsi-35000c50092935686-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XM1Y-part1', 'wwn-0x5000c50092935686-part1'], 'uuids': ['fcc12580-8f3b-4cec-aef7-e7427fa239b7'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM1Y", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM1Y", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM1Y", "scsi-35000c50092935686", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XM1Y", "wwn-0x5000c50092935686"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM1Y-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM1Y-part1", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM1Y-part1", "scsi-35000c50092935686-part1 2021-08-21T14:58:57.775 INFO:teuthology.task.ansible.out:", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XM1Y-part1", "wwn-0x5000c50092935686-part1"], "labels": [], "masters": [], "uuids": ["fcc12580-8f3b-4cec-aef7-e7427fa239b7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XM1Y", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092935686"}}, "skip_reason": "Conditional result was False"} 2021-08-21T14:58:59.019 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QvBmc86zKOtoyfbpNsgSRI85mO2wtdNTV'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.063389", "end": "2021-08-21 14:58:58.988187", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QvBmc86zKOtoyfbpNsgSRI85mO2wtdNTV"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:57.924798", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-08-21T14:58:59.047 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:58:59 +0000 (0:00:07.935) 0:03:57.099 ******* 2021-08-21T14:58:59.449 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-08-21T14:58:59.450 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QvkjK5kIcxqa5WSXTaBPnTf1r2ZBRqZi3'], 'uuids': ['dc1019e9-85a3-43b7-95bb-55a0c4f3ef2b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.144164", "end": "2021-08-21 14:58:59.421992", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QvkjK5kIcxqa5WSXTaBPnTf1r2ZBRqZi3"], "labels": [], "masters": [], "uuids": ["dc1019e9-85a3-43b7-95bb-55a0c4f3ef2b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:59.277828", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1414 s, 816 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1414 s, 816 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-21T14:58:59.673 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-NmG8ll-xqSz-85u8-uMgi-IBGA-grTF-Bmb4Rc', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204019S400BGN', 'nvme-nvme.8086-50484654363230343031395334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.040036", "end": "2021-08-21 14:58:59.641280", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-NmG8ll-xqSz-85u8-uMgi-IBGA-grTF-Bmb4Rc", "nvme-INTEL_SSDPEDMD400G4_PHFT6204019S400BGN", "nvme-nvme.8086-50484654363230343031395334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:59.601244", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0373236 s, 3.1 GB/s", "std 2021-08-21T14:58:59.674 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0373236 s, 3.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-08-21T14:58:59.989 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QtrVMF3Ex3Bod8eLDcTeNccZj8v35FDV7'], 'uuids': ['fe0ec41c-877e-4abe-8f81-43807fce508b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144432", "end": "2021-08-21 14:58:59.961620", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QtrVMF3Ex3Bod8eLDcTeNccZj8v35FDV7"], "labels": [], "masters": [], "uuids": ["fe0ec41c-877e-4abe-8f81-43807fce508b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:58:59.817188", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141879 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141879 s, 813 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:00.306 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QujLhdblSjMimQHbw3h4Udvt5ywyQxEMf'], 'uuids': ['0db160c0-4a32-4d75-9ff9-4201f105193f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.143700", "end": "2021-08-21 14:59:00.278404", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QujLhdblSjMimQHbw3h4Udvt5ywyQxEMf"], "labels": [], "masters": [], "uuids": ["0db160c0-4a32-4d75-9ff9-4201f105193f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:59:00.134704", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141051 s, 818 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141051 s, 818 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:00.621 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QTv3DdGcyy9SB225GpZxt33RorQItBPZ0'], 'uuids': ['84ef676b-b4f7-4407-9a7a-1f575f8b8364'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.147070", "end": "2021-08-21 14:59:00.599590", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QTv3DdGcyy9SB225GpZxt33RorQItBPZ0"], "labels": [], "masters": [], "uuids": ["84ef676b-b4f7-4407-9a7a-1f575f8b8364"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:59:00.452520", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144424 s, 799 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144424 s, 799 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:00.633 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM1Y', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM1Y', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM1Y', 'scsi-35000c50092935686', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XM1Y', 'wwn-0x5000c50092935686'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XM1Y', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092935686', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM1Y-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM1Y-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM1Y-part1', 'scsi-35000c50092935686-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XM1Y-part1', 'wwn-0x5000c50092935686-part1'], 'uuids': ['fcc12580-8f3b-4cec-aef7-e7427fa239b7'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM1Y", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM1Y", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM1Y", "scsi-35000c50092935686", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XM1Y", "wwn-0x5000c50092935686"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM1Y-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM1Y-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-08-21T14:59:00.634 INFO:teuthology.task.ansible.out:Z1W5XM1Y-part1", "scsi-35000c50092935686-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XM1Y-part1", "wwn-0x5000c50092935686-part1"], "labels": [], "masters": [], "uuids": ["fcc12580-8f3b-4cec-aef7-e7427fa239b7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XM1Y", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092935686"}}, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:00.937 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QvBmc86zKOtoyfbpNsgSRI85mO2wtdNTV'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.142246", "end": "2021-08-21 14:59:00.915730", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-SeOAZB7l4gWR6HNFhoxkGyM4tuMDTt8QvBmc86zKOtoyfbpNsgSRI85mO2wtdNTV"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-08-21 14:59:00.773484", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139578 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139578 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:00.982 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:00 +0000 (0:00:01.932) 0:03:59.031 ******* 2021-08-21T14:59:01.247 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi173.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.042188", "end": "2021-08-21 14:59:01.178986", "rc": 0, "start": "2021-08-21 14:59:01.136798", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:01.268 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:01 +0000 (0:00:00.289) 0:03:59.321 ******* 2021-08-21T14:59:01.503 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-08-21T14:59:01.505 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052909", "end": "2021-08-21 14:59:01.484958", "rc": 0, "start": "2021-08-21 14:59:01.432049", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:01.528 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:01 +0000 (0:00:00.258) 0:03:59.580 ******* 2021-08-21T14:59:01.616 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-08-21T14:59:01.686 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:01 +0000 (0:00:00.148) 0:03:59.729 ******* 2021-08-21T14:59:01.716 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:01.744 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:01 +0000 (0:00:00.066) 0:03:59.795 ******* 2021-08-21T14:59:01.771 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:01.792 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:01 +0000 (0:00:00.049) 0:03:59.845 ******* 2021-08-21T14:59:01.820 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:01.843 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:01 +0000 (0:00:00.050) 0:03:59.896 ******* 2021-08-21T14:59:01.882 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:01.906 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:01 +0000 (0:00:00.062) 0:03:59.958 ******* 2021-08-21T14:59:02.107 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi173.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-08-21T14:59:02.130 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:02 +0000 (0:00:00.224) 0:04:00.182 ******* 2021-08-21T14:59:02.178 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-08-21T14:59:02.180 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930259275776, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114081, 'block_used': 12981027, 'inode_total': 61054976, 'inode_available': 60985860, 'inode_used': 69116, 'uuid': 'fcc12580-8f3b-4cec-aef7-e7427fa239b7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114081, "block_size": 4096, "block_total": 240095108, "block_used": 12981027, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985860, "inode_total": 61054976, "inode_used": 69116, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930259275776, "size_total": 983429562368, "uuid": "fcc12580-8f3b-4cec-aef7-e7427fa239b7"}, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:02.209 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:02 +0000 (0:00:00.076) 0:04:00.259 ******* 2021-08-21T14:59:02.247 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:02.267 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:02 +0000 (0:00:00.060) 0:04:00.320 ******* 2021-08-21T14:59:02.294 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:02.318 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:02 +0000 (0:00:00.050) 0:04:00.370 ******* 2021-08-21T14:59:02.349 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:02.371 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:02 +0000 (0:00:00.053) 0:04:00.423 ******* 2021-08-21T14:59:02.402 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-08-21T14:59:02.404 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:02.432 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:02 +0000 (0:00:00.055) 0:04:00.479 ******* 2021-08-21T14:59:02.466 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:02.492 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:02 +0000 (0:00:00.062) 0:04:00.542 ******* 2021-08-21T14:59:02.530 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-08-21T14:59:02.532 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:02.559 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:02 +0000 (0:00:00.069) 0:04:00.611 ******* 2021-08-21T14:59:03.089 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-08-21T14:59:03.109 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:03 +0000 (0:00:00.549) 0:04:01.161 ******* 2021-08-21T14:59:03.576 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-08-21T14:59:03.577 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-21T14:59:04.094 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-21T14:59:04.428 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-21T14:59:04.782 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-21T14:59:05.117 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-08-21T14:59:05.141 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:05 +0000 (0:00:02.032) 0:04:03.194 ******* 2021-08-21T14:59:05.330 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-08-21T14:59:05.332 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-08-21T14:59:05.355 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:05 +0000 (0:00:00.213) 0:04:03.407 ******* 2021-08-21T14:59:05.563 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-08-21T14:59:05.565 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-21T14:59:05.742 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-21T14:59:05.911 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-21T14:59:06.078 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-08-21T14:59:06.089 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:06.114 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:06 +0000 (0:00:00.758) 0:04:04.166 ******* 2021-08-21T14:59:06.141 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-08-21T14:59:06.143 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:06.163 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:06 +0000 (0:00:00.049) 0:04:04.216 ******* 2021-08-21T14:59:06.190 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-08-21T14:59:06.192 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:06.212 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:06 +0000 (0:00:00.049) 0:04:04.265 ******* 2021-08-21T14:59:06.406 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-08-21T14:59:06.408 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-21T14:59:06.431 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:06 +0000 (0:00:00.215) 0:04:04.480 ******* 2021-08-21T14:59:06.465 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-08-21T14:59:06.467 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-08-21T14:59:06.491 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:06 +0000 (0:00:00.062) 0:04:04.543 ******* 2021-08-21T14:59:06.861 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-08-21T14:59:06.863 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true} 2021-08-21T14:59:06.900 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:06 +0000 (0:00:00.409) 0:04:04.952 ******* 2021-08-21T14:59:07.432 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-08-21T14:59:07.467 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} Saturday 21 August 2021 14:59:07 +0000 (0:00:00.559) 0:04:05.512 ******* 2021-08-21T14:59:07.488 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-08-21T14:59:07.490 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.511 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.051) 0:04:05.564 ******* 2021-08-21T14:59:07.538 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-08-21T14:59:07.540 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.564 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.053) 0:04:05.617 ******* 2021-08-21T14:59:07.591 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-08-21T14:59:07.593 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.615 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.050) 0:04:05.667 ******* 2021-08-21T14:59:07.642 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-08-21T14:59:07.644 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.666 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.051) 0:04:05.718 ******* 2021-08-21T14:59:07.694 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-08-21T14:59:07.696 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.716 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.050) 0:04:05.769 ******* 2021-08-21T14:59:07.743 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-08-21T14:59:07.745 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.765 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.049) 0:04:05.818 ******* 2021-08-21T14:59:07.792 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-08-21T14:59:07.794 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.814 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.048) 0:04:05.867 ******* 2021-08-21T14:59:07.841 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-08-21T14:59:07.842 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.864 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.049) 0:04:05.916 ******* 2021-08-21T14:59:07.891 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.918 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.053) 0:04:05.970 ******* 2021-08-21T14:59:07.947 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:07.968 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:07 +0000 (0:00:00.050) 0:04:06.021 ******* 2021-08-21T14:59:07.996 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-08-21T14:59:07.997 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:08.019 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:08 +0000 (0:00:00.050) 0:04:06.071 ******* 2021-08-21T14:59:08.045 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:08.075 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:08 +0000 (0:00:00.055) 0:04:06.127 ******* 2021-08-21T14:59:08.104 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-08-21T14:59:08.106 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:08.128 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:08 +0000 (0:00:00.053) 0:04:06.181 ******* 2021-08-21T14:59:08.155 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-08-21T14:59:08.157 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:08.177 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:08 +0000 (0:00:00.049) 0:04:06.230 ******* 2021-08-21T14:59:08.204 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-08-21T14:59:08.206 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:08.226 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:08 +0000 (0:00:00.048) 0:04:06.278 ******* 2021-08-21T14:59:08.683 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-08-21T14:59:08.685 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-08-21T14:59:08.706 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:08 +0000 (0:00:00.479) 0:04:06.758 ******* 2021-08-21T14:59:09.018 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-08-21T14:59:09.021 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "807", "ExecMainStartTimestamp": "Sat 2021-08-21 14:54:49 UTC", "ExecMainStartTimestampMonotonic": "12207319", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSI 2021-08-21T14:59:09.022 INFO:teuthology.task.ansible.out:ZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127246", "LimitNPROCSoft": "127246", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127246", "LimitSIGPENDINGSoft": "127246", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "807", "MemoryAccounting": "yes", "MemoryCurrent": "2211840", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203593", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Sat 2021-08-21 1 2021-08-21T14:59:09.025 INFO:teuthology.task.ansible.out:4:54:49 UTC", "WatchdogTimestampMonotonic": "12207330", "WatchdogUSec": "0"}} 2021-08-21T14:59:09.046 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:09 +0000 (0:00:00.339) 0:04:07.097 ******* 2021-08-21T14:59:09.074 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-08-21T14:59:09.098 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:09 +0000 (0:00:00.052) 0:04:07.150 ******* 2021-08-21T14:59:09.137 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-21T14:59:09.139 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-08-21T14:59:09.158 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:09 +0000 (0:00:00.060) 0:04:07.211 ******* 2021-08-21T14:59:09.187 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:09.208 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:09 +0000 (0:00:00.049) 0:04:07.260 ******* 2021-08-21T14:59:09.235 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:09.257 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:09 +0000 (0:00:00.049) 0:04:07.310 ******* 2021-08-21T14:59:09.284 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:09.306 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:09 +0000 (0:00:00.048) 0:04:07.358 ******* 2021-08-21T14:59:09.505 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-08-21T14:59:09.508 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-08-21T14:59:09.531 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:09 +0000 (0:00:00.225) 0:04:07.583 ******* 2021-08-21T14:59:09.998 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-08-21T14:59:10.000 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-08-21T14:59:10.029 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:10 +0000 (0:00:00.497) 0:04:08.081 ******* 2021-08-21T14:59:11.131 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-08-21T14:59:11.133 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-08-21T14:59:11.154 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:11 +0000 (0:00:01.125) 0:04:09.206 ******* 2021-08-21T14:59:11.182 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-08-21T14:59:11.184 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:11.205 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:11 +0000 (0:00:00.051) 0:04:09.258 ******* 2021-08-21T14:59:11.233 INFO:teuthology.task.ansible.out: 2021-08-21T14:59:11.235 INFO:teuthology.task.ansible.out:TASK [testnode : Set interface] ************************************************ ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-08-21T14:59:11.256 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:11 +0000 (0:00:00.050) 0:04:09.308 ******* 2021-08-21T14:59:11.439 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-08-21T14:59:11.462 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:11 +0000 (0:00:00.206) 0:04:09.515 ******* 2021-08-21T14:59:11.493 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-08-21T14:59:11.495 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:11.517 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:11 +0000 (0:00:00.054) 0:04:09.569 ******* 2021-08-21T14:59:11.544 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-08-21T14:59:11.545 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-08-21T14:59:11.572 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:11 +0000 (0:00:00.055) 0:04:09.624 ******* 2021-08-21T14:59:11.600 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:11.624 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:11 +0000 (0:00:00.051) 0:04:09.676 ******* 2021-08-21T14:59:11.817 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-08-21T14:59:11.818 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-08-21T14:59:11.839 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:11 +0000 (0:00:00.215) 0:04:09.891 ******* 2021-08-21T14:59:12.035 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-08-21T14:59:12.037 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-08-21T14:59:12.057 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.218) 0:04:10.110 ******* 2021-08-21T14:59:12.084 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-08-21T14:59:12.086 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.107 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.049) 0:04:10.160 ******* 2021-08-21T14:59:12.155 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-08-21T14:59:12.157 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.167 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.167 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.168 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.191 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.083) 0:04:10.243 ******* 2021-08-21T14:59:12.228 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-08-21T14:59:12.231 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi173.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.241 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.241 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.242 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.271 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.080) 0:04:10.323 ******* 2021-08-21T14:59:12.300 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-08-21T14:59:12.302 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.334 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.063) 0:04:10.386 ******* 2021-08-21T14:59:12.374 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-08-21T14:59:12.375 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.401 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.066) 0:04:10.453 ******* 2021-08-21T14:59:12.428 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.453 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.052) 0:04:10.505 ******* 2021-08-21T14:59:12.479 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-08-21T14:59:12.482 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.504 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.051) 0:04:10.557 ******* 2021-08-21T14:59:12.532 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-08-21T14:59:12.533 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.556 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.052) 0:04:10.609 ******* 2021-08-21T14:59:12.593 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-08-21T14:59:12.595 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.618 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.061) 0:04:10.670 ******* 2021-08-21T14:59:12.645 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-08-21T14:59:12.647 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.669 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.051) 0:04:10.722 ******* 2021-08-21T14:59:12.696 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-08-21T14:59:12.697 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:12.718 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:12 +0000 (0:00:00.048) 0:04:10.770 ******* 2021-08-21T14:59:12.934 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-08-21T14:59:12.935 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005087", "end": "2021-08-21 14:59:12.905808", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-08-21 14:59:12.900721", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:13.113 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003016", "end": "2021-08-21 14:59:13.082782", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-08-21 14:59:13.079766", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:13.290 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002827", "end": "2021-08-21 14:59:13.255847", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-08-21 14:59:13.253020", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:13.467 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003149", "end": "2021-08-21 14:59:13.436329", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-08-21 14:59:13.433180", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:13.492 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:13 +0000 (0:00:00.774) 0:04:11.545 ******* 2021-08-21T14:59:13.527 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-08-21T14:59:13.550 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:13 +0000 (0:00:00.057) 0:04:11.602 ******* 2021-08-21T14:59:13.577 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-08-21T14:59:13.579 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:13.652 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-08-21T14:59:13.670 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:13 +0000 (0:00:00.120) 0:04:11.723 ******* 2021-08-21T14:59:16.332 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi173.front.sepia.ceph.com] 2021-08-21T14:59:16.381 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:16 +0000 (0:00:02.710) 0:04:14.433 ******* 2021-08-21T14:59:16.408 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:16.430 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:16 +0000 (0:00:00.049) 0:04:14.483 ******* 2021-08-21T14:59:16.457 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-21T14:59:16.459 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-08-21T14:59:16.484 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:16 +0000 (0:00:00.053) 0:04:14.536 ******* 2021-08-21T14:59:16.532 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-08-21T14:59:16.534 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-08-21T14:59:16.555 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:16 +0000 (0:00:00.070) 0:04:14.607 ******* 2021-08-21T14:59:22.152 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-08-21T14:59:22.154 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: podman-catatonit-3.2.3-0.10.module_el8.4.0+886+c9a8d9ad.x86_64", "Installed: podman-3.2.3-0.10.module_el8.4.0+886+c9a8d9ad.x86_64", "Installed: podman-docker-3.2.3-0.10.module_el8.4.0+886+c9a8d9ad.noarch", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-08-21T14:59:22.174 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:22 +0000 (0:00:05.619) 0:04:20.226 ******* 2021-08-21T14:59:22.201 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-21T14:59:22.203 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-08-21T14:59:22.223 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:22 +0000 (0:00:00.048) 0:04:20.275 ******* 2021-08-21T14:59:22.249 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-08-21T14:59:22.251 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:22.271 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:22 +0000 (0:00:00.048) 0:04:20.324 ******* 2021-08-21T14:59:22.495 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi173.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-21T14:59:22.682 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-08-21T14:59:22.708 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:22 +0000 (0:00:00.436) 0:04:20.760 ******* 2021-08-21T14:59:23.182 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-08-21T14:59:23.184 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-08-21T14:59:23.610 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-08-21T14:59:23.634 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:23 +0000 (0:00:00.926) 0:04:21.686 ******* 2021-08-21T14:59:25.174 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-08-21T14:59:25.198 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:25 +0000 (0:00:01.563) 0:04:23.251 ******* 2021-08-21T14:59:27.580 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** ok: [smithi173.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-mbxrqvh0-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-mbxrqvh0-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0 2021-08-21T14:59:27.582 INFO:teuthology.task.ansible.out::", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-08-21T14:59:27.613 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:27 +0000 (0:00:02.409) 0:04:25.660 ******* 2021-08-21T14:59:27.636 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:27.672 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:27 +0000 (0:00:00.063) 0:04:25.723 ******* 2021-08-21T14:59:27.710 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-08-21T14:59:27.712 INFO:teuthology.task.ansible.out:skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:27.733 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:27 +0000 (0:00:00.061) 0:04:25.785 ******* 2021-08-21T14:59:28.079 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-08-21T14:59:28.081 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.154953", "end": "2021-08-21 14:59:28.060072", "rc": 0, "start": "2021-08-21 14:59:27.905119", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-08-21T14:59:28.101 INFO:teuthology.task.ansible.out:Saturday 21 August 2021 14:59:28 +0000 (0:00:00.368) 0:04:26.153 ******* 2021-08-21T14:59:28.128 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* skipping: [smithi173.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-08-21T14:59:28.195 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-08-21T14:59:28.197 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-08-21T14:59:28.198 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-08-21T14:59:28.199 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-08-21T14:59:28.212 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Saturday 21 August 2021 14:59:28 +0000 (0:00:00.111) 0:04:26.265 ******* 2021-08-21T14:59:28.840 INFO:teuthology.task.ansible.out:ok: [smithi173.front.sepia.ceph.com] 2021-08-21T14:59:28.857 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Saturday 21 August 2021 14:59:28 +0000 (0:00:00.644) 0:04:26.909 ******* 2021-08-21T14:59:29.059 INFO:teuthology.task.ansible.out:changed: [smithi173.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-08-21T14:59:29.061 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi173.front.sepia.ceph.com : ok=132 changed=39 unreachable=0 failed=0 skipped=188 rescued=0 ignored=3 2021-08-21T14:59:29.062 INFO:teuthology.task.ansible.out: Saturday 21 August 2021 14:59:29 +0000 (0:00:00.204) 0:04:27.114 ******* =============================================================================== 2021-08-21T14:59:29.063 INFO:teuthology.task.ansible.out:common : nrpe - Ensure SELinux policy is up to date -------------------- 37.57s Create all admin users with sudo access. ------------------------------- 35.97s users : Update authorized_keys using the keys repo --------------------- 32.36s common : nrpe - Load SELinux policy package ---------------------------- 15.01s common : nrpe - Remove SELinux policy package -------------------------- 14.91s Remove revoked users ---------------------------------------------------- 9.55s testnode : Zap all non-root disks --------------------------------------- 7.94s testnode : Install packages --------------------------------------------- 7.33s container-host : Install container packages ----------------------------- 5.62s testnode : Ensure ceph packages are not present. ------------------------ 4.30s common : Install Kerberos Packages (RedHat) ----------------------------- 3.63s Gathering Facts --------------------------------------------------------- 2.86s Gathering Facts --------------------------------------------------------- 2.71s testnode : Ensure ceph dependency packages are not present. ------------- 2.59s testnode : Rebuild rpmdb ------------------------------------------------ 2.51s container-host : Install registries-conf-ctl ---------------------------- 2.41s testnode : Create logical volume(s) ------------------------------------- 2.03s testnode : Remove packages ---------------------------------------------- 1.97s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.93s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.86s 2021-08-21T14:59:29.442 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2021-08-21T14:59:29.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-08-21T14:59:29.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-08-21T14:59:29.517 DEBUG:teuthology.orchestra.run.smithi173:> true 2021-08-21T14:59:29.599 INFO:teuthology.run_tasks:Running task clock... 2021-08-21T14:59:29.611 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-08-21T14:59:29.612 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-08-21T14:59:29.614 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-08-21T14:59:29.670 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-08-21T14:59:29.683 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-08-21T14:59:29.717 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2021-08-21T14:59:29.725 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2021-08-21T14:59:29.739 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-08-21T14:59:29.752 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-08-21T14:59:29.811 INFO:teuthology.orchestra.run.smithi173.stderr:bash: ntpq: command not found 2021-08-21T14:59:29.813 INFO:teuthology.orchestra.run.smithi173.stdout:210 Number of sources = 4 2021-08-21T14:59:29.814 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-08-21T14:59:29.814 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2021-08-21T14:59:29.814 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-21T14:59:29.815 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-21T14:59:29.815 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-21T14:59:29.815 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-08-21T14:59:29.815 INFO:teuthology.run_tasks:Running task install... 2021-08-21T14:59:29.824 DEBUG:teuthology.task.install:project ceph 2021-08-21T14:59:29.824 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6'}} 2021-08-21T14:59:29.825 DEBUG:teuthology.task.install:config {'sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6'} 2021-08-21T14:59:29.825 INFO:teuthology.task.install:Using flavor: basic 2021-08-21T14:59:29.832 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-08-21T14:59:29.832 INFO:teuthology.task.install:extra packages: [] 2021-08-21T14:59:29.833 DEBUG:teuthology.orchestra.run.smithi173:> sudo lsb_release -is 2021-08-21T14:59:29.886 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS 2021-08-21T14:59:29.887 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-21T14:59:29.888 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6', 'tag': None, 'wait_for_package': False} 2021-08-21T14:59:29.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo lsb_release -is 2021-08-21T14:59:29.959 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS 2021-08-21T14:59:29.961 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-21T14:59:29.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cae1ffd55a16af4627c36508fde05bf24312fad6 2021-08-21T14:59:30.111 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri-master-8.20.21/cae1ffd55a16af4627c36508fde05bf24312fad6/centos/8/flavors/default/ 2021-08-21T14:59:30.112 INFO:teuthology.task.install.rpm:Package version is 17.0.0-7135.gcae1ffd5 2021-08-21T14:59:30.465 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-master-8.20.21/cae1ffd55a16af4627c36508fde05bf24312fad6/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-master-8.20.21/cae1ffd55a16af4627c36508fde05bf24312fad6/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-master-8.20.21/cae1ffd55a16af4627c36508fde05bf24312fad6/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-08-21T14:59:30.466 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T14:59:30.466 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-08-21T14:59:30.492 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-08-21T14:59:30.493 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cae1ffd55a16af4627c36508fde05bf24312fad6/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-08-21T14:59:30.558 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-08-21T14:59:30.633 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-08-21T14:59:30.696 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2021-08-21T14:59:30.697 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2021-08-21T14:59:30.927 INFO:teuthology.orchestra.run.smithi173.stdout:84 files removed 2021-08-21T14:59:30.947 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw 2021-08-21T14:59:31.505 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 327 kB/s | 76 kB 00:00 2021-08-21T14:59:31.741 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 36 kB/s | 7.3 kB 00:00 2021-08-21T14:59:31.949 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 7.8 kB/s | 1.4 kB 00:00 2021-08-21T14:59:32.138 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - AppStream 53 MB/s | 8.8 MB 00:00 2021-08-21T14:59:33.651 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - Base 45 MB/s | 5.6 MB 00:00 2021-08-21T14:59:34.527 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - Extras 88 kB/s | 10 kB 00:00 2021-08-21T14:59:36.118 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Linux 8 - AppStream 5.7 MB/s | 8.8 MB 00:01 2021-08-21T14:59:39.946 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Linux 8 - BaseOS 2.2 MB/s | 5.6 MB 00:02 2021-08-21T14:59:41.054 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Linux 8 - Extras 31 kB/s | 10 kB 00:00 2021-08-21T14:59:41.201 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - PowerTools 25 MB/s | 2.3 MB 00:00 2021-08-21T14:59:43.791 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2021-08-21T14:59:45.568 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 6.0 MB/s | 10 MB 00:01 2021-08-21T14:59:47.654 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-08-21T14:59:49.897 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T14:59:49.899 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T14:59:49.900 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T14:59:49.900 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T14:59:49.900 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T14:59:49.900 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 8.5 M 2021-08-21T14:59:49.900 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2021-08-21T14:59:49.901 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 3.4 M 2021-08-21T14:59:49.901 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 3.9 M 2021-08-21T14:59:49.901 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T14:59:49.901 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 5.2 M 2021-08-21T14:59:49.902 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 20 M 2021-08-21T14:59:49.902 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 24 k 2021-08-21T14:59:49.902 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-08-21T14:59:49.902 INFO:teuthology.orchestra.run.smithi173.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-08-21T14:59:49.903 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 782 k 2021-08-21T14:59:49.903 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-08-21T14:59:49.903 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-08-21T14:59:49.903 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 482 k 2021-08-21T14:59:49.903 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-08-21T14:59:49.904 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 3.7 M 2021-08-21T14:59:49.904 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-08-21T14:59:49.904 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-08-21T14:59:49.904 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse 2021-08-21T14:59:49.905 INFO:teuthology.orchestra.run.smithi173.stdout: x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 45 k 2021-08-21T14:59:49.905 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 78 k 2021-08-21T14:59:49.905 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 178 k 2021-08-21T14:59:49.905 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-08-21T14:59:49.906 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 365 k 2021-08-21T14:59:49.906 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 346 k 2021-08-21T14:59:49.906 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 109 k 2021-08-21T14:59:49.906 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T14:59:49.907 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T14:59:49.907 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T14:59:49.907 INFO:teuthology.orchestra.run.smithi173.stdout:Install 21 Packages 2021-08-21T14:59:49.908 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 2 Packages 2021-08-21T14:59:49.908 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T14:59:49.909 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 48 M 2021-08-21T14:59:49.909 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T14:59:50.444 INFO:teuthology.orchestra.run.smithi173.stdout:(1/23): ceph-base-17.0.0-7135.gcae1ffd5.el8.x86 9.6 MB/s | 5.2 MB 00:00 2021-08-21T14:59:50.492 INFO:teuthology.orchestra.run.smithi173.stdout:(2/23): ceph-selinux-17.0.0-7135.gcae1ffd5.el8. 509 kB/s | 24 kB 00:00 2021-08-21T14:59:50.572 INFO:teuthology.orchestra.run.smithi173.stdout:(3/23): libcephfs2-17.0.0-7135.gcae1ffd5.el8.x8 9.6 MB/s | 782 kB 00:00 2021-08-21T14:59:50.644 INFO:teuthology.orchestra.run.smithi173.stdout:(4/23): libradosstriper1-17.0.0-7135.gcae1ffd5. 6.5 MB/s | 482 kB 00:00 2021-08-21T14:59:50.828 INFO:teuthology.orchestra.run.smithi173.stdout:(5/23): ceph-radosgw-17.0.0-7135.gcae1ffd5.el8. 9.2 MB/s | 8.5 MB 00:00 2021-08-21T14:59:50.877 INFO:teuthology.orchestra.run.smithi173.stdout:(6/23): python3-ceph-argparse-17.0.0-7135.gcae1 916 kB/s | 45 kB 00:00 2021-08-21T14:59:50.925 INFO:teuthology.orchestra.run.smithi173.stdout:(7/23): python3-ceph-common-17.0.0-7135.gcae1ff 1.6 MB/s | 78 kB 00:00 2021-08-21T14:59:50.952 INFO:teuthology.orchestra.run.smithi173.stdout:(8/23): librgw2-17.0.0-7135.gcae1ffd5.el8.x86_6 12 MB/s | 3.7 MB 00:00 2021-08-21T14:59:50.967 INFO:teuthology.orchestra.run.smithi173.stdout:(9/23): python3-cephfs-17.0.0-7135.gcae1ffd5.el 4.1 MB/s | 178 kB 00:00 2021-08-21T14:59:50.991 INFO:teuthology.orchestra.run.smithi173.stdout:(10/23): python3-rados-17.0.0-7135.gcae1ffd5.el 9.3 MB/s | 365 kB 00:00 2021-08-21T14:59:51.012 INFO:teuthology.orchestra.run.smithi173.stdout:(11/23): python3-rbd-17.0.0-7135.gcae1ffd5.el8. 7.6 MB/s | 346 kB 00:00 2021-08-21T14:59:51.027 INFO:teuthology.orchestra.run.smithi173.stdout:(12/23): python3-rgw-17.0.0-7135.gcae1ffd5.el8. 3.0 MB/s | 109 kB 00:00 2021-08-21T14:59:51.047 INFO:teuthology.orchestra.run.smithi173.stdout:(13/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2021-08-21T14:59:51.048 INFO:teuthology.orchestra.run.smithi173.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 36 MB/s | 44 kB 00:00 2021-08-21T14:59:51.049 INFO:teuthology.orchestra.run.smithi173.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 38 MB/s | 47 kB 00:00 2021-08-21T14:59:51.068 INFO:teuthology.orchestra.run.smithi173.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2021-08-21T14:59:51.230 INFO:teuthology.orchestra.run.smithi173.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2021-08-21T14:59:51.259 INFO:teuthology.orchestra.run.smithi173.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 950 kB/s | 181 kB 00:00 2021-08-21T14:59:51.266 INFO:teuthology.orchestra.run.smithi173.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 1.6 MB/s | 59 kB 00:00 2021-08-21T14:59:51.282 INFO:teuthology.orchestra.run.smithi173.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 3.2 MB/s | 75 kB 00:00 2021-08-21T14:59:51.570 INFO:teuthology.orchestra.run.smithi173.stdout:(21/23): librados2-17.0.0-7135.gcae1ffd5.el8.x8 11 MB/s | 3.4 MB 00:00 2021-08-21T14:59:51.624 INFO:teuthology.orchestra.run.smithi173.stdout:(22/23): librbd1-17.0.0-7135.gcae1ffd5.el8.x86_ 11 MB/s | 3.9 MB 00:00 2021-08-21T14:59:51.980 INFO:teuthology.orchestra.run.smithi173.stdout:(23/23): ceph-common-17.0.0-7135.gcae1ffd5.el8. 9.4 MB/s | 20 MB 00:02 2021-08-21T14:59:51.983 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T14:59:51.984 INFO:teuthology.orchestra.run.smithi173.stdout:Total 23 MB/s | 48 MB 00:02 2021-08-21T14:59:51.987 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T14:59:52.032 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T14:59:52.033 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T14:59:52.454 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T14:59:52.457 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T14:59:53.426 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T14:59:53.611 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-08-21T14:59:53.747 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-08-21T14:59:54.152 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-08-21T14:59:54.305 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 3/25 2021-08-21T14:59:54.398 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 3/25 2021-08-21T14:59:54.612 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:17.0.0-7135.gcae1ffd5.el8.x86_64 4/25 2021-08-21T14:59:54.754 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 5/25 2021-08-21T14:59:55.178 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 5/25 2021-08-21T14:59:55.361 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:17.0.0-7135.gcae1ffd5.el8.x86_64 6/25 2021-08-21T14:59:55.424 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:17.0.0-7135.gcae1ffd5.el8.x86_64 6/25 2021-08-21T14:59:55.570 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-08-21T14:59:55.730 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-08-21T14:59:56.118 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-08-21T14:59:56.271 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 9/25 2021-08-21T14:59:56.346 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 9/25 2021-08-21T14:59:56.477 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-08-21T14:59:56.639 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:17.0.0-7135.gcae1ffd5.el8. 11/25 2021-08-21T14:59:56.808 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:17.0.0-7135.gcae1ffd5.el8.x86_64 12/25 2021-08-21T14:59:57.021 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:17.0.0-7135.gcae1ffd5.el8.x86_64 13/25 2021-08-21T14:59:57.206 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 14/25 2021-08-21T14:59:57.354 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:17.0.0-7135.gcae1ffd5.el8.x86_6 15/25 2021-08-21T14:59:57.408 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:17.0.0-7135.gcae1ffd5.el8.x86_6 15/25 2021-08-21T14:59:57.572 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-08-21T14:59:57.779 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-08-21T14:59:57.930 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-08-21T14:59:58.088 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:17.0.0-7135.gcae1ffd5.el8.x8 19/25 2021-08-21T15:00:02.444 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:17.0.0-7135.gcae1ffd5.el8.x86_64 20/25 2021-08-21T15:00:02.637 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:17.0.0-7135.gcae1ffd5.el8.x86_64 20/25 2021-08-21T15:00:03.212 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:17.0.0-7135.gcae1ffd5.el8.x86_64 20/25 2021-08-21T15:00:03.425 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:17.0.0-7135.gcae1ffd5.el8.x86_64 21/25 2021-08-21T15:00:03.527 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:17.0.0-7135.gcae1ffd5.el8.x86_64 21/25 2021-08-21T15:00:03.637 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:17.0.0-7135.gcae1ffd5.el8.x86_64 22/25 2021-08-21T15:00:19.216 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:17.0.0-7135.gcae1ffd5.el8.x86_64 22/25 2021-08-21T15:00:19.217 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2021-08-21T15:00:19.217 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2021-08-21T15:00:19.218 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2021-08-21T15:00:19.218 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /run 2021-08-21T15:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2021-08-21T15:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2021-08-21T15:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2021-08-21T15:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2021-08-21T15:00:19.219 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2021-08-21T15:00:19.220 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:20.239 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:17.0.0-7135.gcae1ffd5.el8.x86_64 23/25 2021-08-21T15:00:20.299 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-7135.gcae1ffd5.el8.x86_64 23/25 2021-08-21T15:00:20.300 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-08-21T15:00:20.520 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-08-21T15:00:20.520 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-08-21T15:00:21.353 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-08-21T15:00:21.354 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/25 2021-08-21T15:00:21.354 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2/25 2021-08-21T15:00:21.354 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:17.0.0-7135.gcae1ffd5.el8.x86_64 3/25 2021-08-21T15:00:21.354 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:17.0.0-7135.gcae1ffd5.el8.x86_64 4/25 2021-08-21T15:00:21.355 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 5/25 2021-08-21T15:00:21.355 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:17.0.0-7135.gcae1ffd5.el8.x86_6 6/25 2021-08-21T15:00:21.355 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 7/25 2021-08-21T15:00:21.355 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:17.0.0-7135.gcae1ffd5.el8. 8/25 2021-08-21T15:00:21.356 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:17.0.0-7135.gcae1ffd5.el8.x8 9/25 2021-08-21T15:00:21.356 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:17.0.0-7135.gcae1ffd5.el8.x86_64 10/25 2021-08-21T15:00:21.358 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:17.0.0-7135.gcae1ffd5.el8.x86_64 11/25 2021-08-21T15:00:21.359 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 12/25 2021-08-21T15:00:21.359 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:17.0.0-7135.gcae1ffd5.el8.x86_64 13/25 2021-08-21T15:00:21.360 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-08-21T15:00:21.360 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-08-21T15:00:21.361 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-08-21T15:00:21.361 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-08-21T15:00:21.362 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-08-21T15:00:21.362 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-08-21T15:00:21.363 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-08-21T15:00:21.363 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-08-21T15:00:21.365 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 22/25 2021-08-21T15:00:21.365 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-08-21T15:00:21.365 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:17.0.0-7135.gcae1ffd5.el8.x86_64 24/25 2021-08-21T15:00:22.208 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-08-21T15:00:22.208 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:22.209 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2021-08-21T15:00:22.209 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.209 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.209 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:22.210 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:00:22.210 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.210 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.210 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.211 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.211 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-08-21T15:00:22.211 INFO:teuthology.orchestra.run.smithi173.stdout: leveldb-1.22-1.el8.x86_64 2021-08-21T15:00:22.211 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.211 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.2-3.el8.x86_64 2021-08-21T15:00:22.212 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-08-21T15:00:22.212 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.212 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-08-21T15:00:22.212 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.213 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.3.1-3.el8.x86_64 2021-08-21T15:00:22.213 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-08-21T15:00:22.213 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.213 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.214 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.214 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-08-21T15:00:22.214 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.215 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.215 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:22.215 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:22.215 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:00:22.459 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test 2021-08-21T15:00:22.913 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:35 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:00:23.881 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:00:23.882 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:23.882 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T15:00:23.882 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:00:23.883 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 43 M 2021-08-21T15:00:23.883 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T15:00:23.883 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-08-21T15:00:23.883 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 170 k 2021-08-21T15:00:23.884 INFO:teuthology.orchestra.run.smithi173.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-08-21T15:00:23.884 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-08-21T15:00:23.884 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-08-21T15:00:23.884 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-08-21T15:00:23.885 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:23.885 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:00:23.885 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:23.885 INFO:teuthology.orchestra.run.smithi173.stdout:Install 7 Packages 2021-08-21T15:00:23.885 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:23.886 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 44 M 2021-08-21T15:00:23.887 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 207 M 2021-08-21T15:00:23.887 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:00:23.923 INFO:teuthology.orchestra.run.smithi173.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 4.1 MB/s | 161 kB 00:00 2021-08-21T15:00:23.927 INFO:teuthology.orchestra.run.smithi173.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 60 MB/s | 187 kB 00:00 2021-08-21T15:00:23.931 INFO:teuthology.orchestra.run.smithi173.stdout:(3/7): socat-1.7.3.3-2.el8.x86_64.rpm 70 MB/s | 302 kB 00:00 2021-08-21T15:00:23.934 INFO:teuthology.orchestra.run.smithi173.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 68 MB/s | 250 kB 00:00 2021-08-21T15:00:24.075 INFO:teuthology.orchestra.run.smithi173.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 512 kB/s | 69 kB 00:00 2021-08-21T15:00:24.091 INFO:teuthology.orchestra.run.smithi173.stdout:(6/7): libcephsqlite-17.0.0-7135.gcae1ffd5.el8. 838 kB/s | 170 kB 00:00 2021-08-21T15:00:26.178 INFO:teuthology.orchestra.run.smithi173.stdout:(7/7): ceph-test-17.0.0-7135.gcae1ffd5.el8.x86_ 19 MB/s | 43 MB 00:02 2021-08-21T15:00:26.182 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:00:26.182 INFO:teuthology.orchestra.run.smithi173.stdout:Total 19 MB/s | 44 MB 00:02 2021-08-21T15:00:26.186 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:00:26.210 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:00:26.211 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:00:26.496 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:00:26.501 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:00:27.169 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:00:27.315 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-08-21T15:00:27.485 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-08-21T15:00:27.640 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/7 2021-08-21T15:00:27.833 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-21T15:00:27.910 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-21T15:00:28.057 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-08-21T15:00:28.208 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:17.0.0-7135.gcae1ffd5.el8.x86_64 6/7 2021-08-21T15:00:32.784 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:17.0.0-7135.gcae1ffd5.el8.x86_64 6/7 2021-08-21T15:00:33.414 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:17.0.0-7135.gcae1ffd5.el8.x86_64 7/7 2021-08-21T15:00:33.667 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-2:17.0.0-7135.gcae1ffd5.el8.x86_64 7/7 2021-08-21T15:00:33.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/7 2021-08-21T15:00:33.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2/7 2021-08-21T15:00:33.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-08-21T15:00:33.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-08-21T15:00:33.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 5/7 2021-08-21T15:00:33.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-08-21T15:00:34.053 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-08-21T15:00:34.054 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:34.054 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:00:34.054 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:17.0.0-7135.gcae1ffd5.el8.x86_64 jq-1.5-12.el8.x86_64 2021-08-21T15:00:34.055 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:17.0.0-7135.gcae1ffd5.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-08-21T15:00:34.055 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.3.3-2.el8.x86_64 2021-08-21T15:00:34.055 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-08-21T15:00:34.055 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:34.056 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:00:34.195 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph 2021-08-21T15:00:34.643 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:47 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:00:35.595 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:00:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2021-08-21T15:00:35.600 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T15:00:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2021-08-21T15:00:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:00:35.600 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 6.4 k 2021-08-21T15:00:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T15:00:35.601 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 2.3 M 2021-08-21T15:00:35.601 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 1.5 M 2021-08-21T15:00:35.601 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:17.0.0-7135.gcae1ffd5.el8 ceph-noarch 211 k 2021-08-21T15:00:35.601 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 3.9 M 2021-08-21T15:00:35.602 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 17 M 2021-08-21T15:00:35.603 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-08-21T15:00:35.603 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-08-21T15:00:35.603 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-08-21T15:00:35.604 INFO:teuthology.orchestra.run.smithi173.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-08-21T15:00:35.604 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-08-21T15:00:35.604 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-08-21T15:00:35.604 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 3.2.1-4.el8 CentOS-Base 559 k 2021-08-21T15:00:35.605 INFO:teuthology.orchestra.run.smithi173.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-08-21T15:00:35.605 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-08-21T15:00:35.605 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-08-21T15:00:35.605 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-08-21T15:00:35.605 INFO:teuthology.orchestra.run.smithi173.stdout: python3-lxml x86_64 4.2.3-2.el8 CentOS-AppStream 1.5 M 2021-08-21T15:00:35.606 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-08-21T15:00:35.606 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-08-21T15:00:35.606 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-08-21T15:00:35.606 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-08-21T15:00:35.606 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-08-21T15:00:35.607 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2021-08-21T15:00:35.607 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-08-21T15:00:35.607 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-08-21T15:00:35.608 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-08-21T15:00:35.608 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-08-21T15:00:35.608 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-08-21T15:00:35.608 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-08-21T15:00:35.608 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-08-21T15:00:35.610 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-08-21T15:00:35.610 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-08-21T15:00:35.610 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-08-21T15:00:35.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-08-21T15:00:35.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-08-21T15:00:35.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-08-21T15:00:35.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-08-21T15:00:35.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-08-21T15:00:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2021-08-21T15:00:35.612 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-08-21T15:00:35.612 INFO:teuthology.orchestra.run.smithi173.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-08-21T15:00:35.612 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:35.613 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:00:35.613 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2021-08-21T15:00:35.613 INFO:teuthology.orchestra.run.smithi173.stdout:Install 41 Packages 2021-08-21T15:00:35.613 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:35.614 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 31 M 2021-08-21T15:00:35.615 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 121 M 2021-08-21T15:00:35.615 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:00:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:(1/41): ceph-17.0.0-7135.gcae1ffd5.el8.x86_64.r 62 kB/s | 6.4 kB 00:00 2021-08-21T15:00:35.860 INFO:teuthology.orchestra.run.smithi173.stdout:(2/41): ceph-mgr-17.0.0-7135.gcae1ffd5.el8.x86_ 6.0 MB/s | 1.5 MB 00:00 2021-08-21T15:00:35.990 INFO:teuthology.orchestra.run.smithi173.stdout:(3/41): ceph-mds-17.0.0-7135.gcae1ffd5.el8.x86_ 5.9 MB/s | 2.3 MB 00:00 2021-08-21T15:00:36.038 INFO:teuthology.orchestra.run.smithi173.stdout:(4/41): ceph-mgr-modules-core-17.0.0-7135.gcae1 4.3 MB/s | 211 kB 00:00 2021-08-21T15:00:36.070 INFO:teuthology.orchestra.run.smithi173.stdout:(5/41): python3-html5lib-0.999999999-6.el8.noar 6.6 MB/s | 214 kB 00:00 2021-08-21T15:00:36.089 INFO:teuthology.orchestra.run.smithi173.stdout:(6/41): python3-lxml-4.2.3-2.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2021-08-21T15:00:36.092 INFO:teuthology.orchestra.run.smithi173.stdout:(7/41): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2021-08-21T15:00:36.093 INFO:teuthology.orchestra.run.smithi173.stdout:(8/41): python3-markupsafe-0.23-19.el8.x86_64.r 29 MB/s | 39 kB 00:00 2021-08-21T15:00:36.095 INFO:teuthology.orchestra.run.smithi173.stdout:(9/41): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 48 MB/s | 103 kB 00:00 2021-08-21T15:00:36.097 INFO:teuthology.orchestra.run.smithi173.stdout:(10/41): python3-pytz-2017.2-9.el8.noarch.rpm 37 MB/s | 54 kB 00:00 2021-08-21T15:00:36.098 INFO:teuthology.orchestra.run.smithi173.stdout:(11/41): python3-webencodings-0.5.1-6.el8.noarc 22 MB/s | 27 kB 00:00 2021-08-21T15:00:36.104 INFO:teuthology.orchestra.run.smithi173.stdout:(12/41): python3-werkzeug-0.12.2-4.el8.noarch.r 74 MB/s | 457 kB 00:00 2021-08-21T15:00:36.108 INFO:teuthology.orchestra.run.smithi173.stdout:(13/41): python3-cffi-1.11.5-5.el8.x86_64.rpm 64 MB/s | 237 kB 00:00 2021-08-21T15:00:36.112 INFO:teuthology.orchestra.run.smithi173.stdout:(14/41): python3-chardet-3.0.4-7.el8.noarch.rpm 60 MB/s | 195 kB 00:00 2021-08-21T15:00:36.119 INFO:teuthology.orchestra.run.smithi173.stdout:(15/41): python3-cryptography-3.2.1-4.el8.x86_6 76 MB/s | 559 kB 00:00 2021-08-21T15:00:36.121 INFO:teuthology.orchestra.run.smithi173.stdout:(16/41): python3-idna-2.5-5.el8.noarch.rpm 45 MB/s | 97 kB 00:00 2021-08-21T15:00:36.123 INFO:teuthology.orchestra.run.smithi173.stdout:(17/41): python3-pycparser-2.14-14.el8.noarch.r 50 MB/s | 109 kB 00:00 2021-08-21T15:00:36.125 INFO:teuthology.orchestra.run.smithi173.stdout:(18/41): python3-pysocks-1.6.8-3.el8.noarch.rpm 27 MB/s | 34 kB 00:00 2021-08-21T15:00:36.127 INFO:teuthology.orchestra.run.smithi173.stdout:(19/41): python3-requests-2.20.0-2.1.el8_1.noar 57 MB/s | 123 kB 00:00 2021-08-21T15:00:36.131 INFO:teuthology.orchestra.run.smithi173.stdout:(20/41): python3-urllib3-1.24.2-5.el8.noarch.rp 49 MB/s | 177 kB 00:00 2021-08-21T15:00:36.217 INFO:teuthology.orchestra.run.smithi173.stdout:(21/41): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 510 kB/s | 44 kB 00:00 2021-08-21T15:00:36.281 INFO:teuthology.orchestra.run.smithi173.stdout:(22/41): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.8 MB/s | 185 kB 00:00 2021-08-21T15:00:36.303 INFO:teuthology.orchestra.run.smithi173.stdout:(23/41): python3-cheroot-8.5.2-1.el8.noarch.rpm 7.4 MB/s | 173 kB 00:00 2021-08-21T15:00:36.349 INFO:teuthology.orchestra.run.smithi173.stdout:(24/41): ceph-mon-17.0.0-7135.gcae1ffd5.el8.x86 6.0 MB/s | 3.9 MB 00:00 2021-08-21T15:00:36.350 INFO:teuthology.orchestra.run.smithi173.stdout:(25/41): python3-cherrypy-18.4.0-1.el8.noarch.r 8.0 MB/s | 384 kB 00:00 2021-08-21T15:00:36.372 INFO:teuthology.orchestra.run.smithi173.stdout:(26/41): python3-jaraco-6.2-6.el8.noarch.rpm 521 kB/s | 11 kB 00:00 2021-08-21T15:00:36.394 INFO:teuthology.orchestra.run.smithi173.stdout:(27/41): python3-jaraco-functools-2.0-4.el8.noa 816 kB/s | 18 kB 00:00 2021-08-21T15:00:36.416 INFO:teuthology.orchestra.run.smithi173.stdout:(28/41): python3-logutils-0.3.5-11.el8.noarch.r 2.2 MB/s | 49 kB 00:00 2021-08-21T15:00:36.430 INFO:teuthology.orchestra.run.smithi173.stdout:(29/41): python3-cssselect-0.9.2-10.el8.noarch. 498 kB/s | 40 kB 00:00 2021-08-21T15:00:36.438 INFO:teuthology.orchestra.run.smithi173.stdout:(30/41): python3-more-itertools-7.2.0-3.el8.noa 2.6 MB/s | 59 kB 00:00 2021-08-21T15:00:36.460 INFO:teuthology.orchestra.run.smithi173.stdout:(31/41): python3-portend-2.6-1.el8.noarch.rpm 720 kB/s | 16 kB 00:00 2021-08-21T15:00:36.483 INFO:teuthology.orchestra.run.smithi173.stdout:(32/41): python3-simplegeneric-0.8.1-17.el8.noa 869 kB/s | 19 kB 00:00 2021-08-21T15:00:36.503 INFO:teuthology.orchestra.run.smithi173.stdout:(33/41): python3-singledispatch-3.4.0.3-18.el8. 1.1 MB/s | 24 kB 00:00 2021-08-21T15:00:36.511 INFO:teuthology.orchestra.run.smithi173.stdout:(34/41): python3-pecan-1.3.2-9.el8.noarch.rpm 3.4 MB/s | 283 kB 00:00 2021-08-21T15:00:36.525 INFO:teuthology.orchestra.run.smithi173.stdout:(35/41): python3-tempora-1.14.1-5.el8.noarch.rp 1.3 MB/s | 29 kB 00:00 2021-08-21T15:00:36.538 INFO:teuthology.orchestra.run.smithi173.stdout:(36/41): python3-trustme-0.6.0-4.el8.noarch.rpm 1.0 MB/s | 27 kB 00:00 2021-08-21T15:00:36.549 INFO:teuthology.orchestra.run.smithi173.stdout:(37/41): python3-waitress-1.2.1-2.el8.1.noarch. 9.8 MB/s | 241 kB 00:00 2021-08-21T15:00:36.573 INFO:teuthology.orchestra.run.smithi173.stdout:(38/41): python3-webob-1.8.5-1.el8.1.noarch.rpm 8.2 MB/s | 251 kB 00:00 2021-08-21T15:00:36.574 INFO:teuthology.orchestra.run.smithi173.stdout:(39/41): python3-webtest-2.0.33-1.el8.noarch.rp 3.8 MB/s | 85 kB 00:00 2021-08-21T15:00:36.595 INFO:teuthology.orchestra.run.smithi173.stdout:(40/41): python3-zc-lockfile-2.0-2.el8.noarch.r 854 kB/s | 23 kB 00:00 2021-08-21T15:00:36.727 INFO:teuthology.orchestra.run.smithi173.stdout:(41/41): ceph-osd-17.0.0-7135.gcae1ffd5.el8.x86 19 MB/s | 17 MB 00:00 2021-08-21T15:00:36.731 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:00:36.732 INFO:teuthology.orchestra.run.smithi173.stdout:Total 27 MB/s | 31 MB 00:01 2021-08-21T15:00:36.745 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:00:36.786 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:00:36.787 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:00:37.106 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:00:37.109 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:00:38.875 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:00:39.123 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/41 2021-08-21T15:00:39.376 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/41 2021-08-21T15:00:39.549 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-idna-2.5-5.el8.noarch 3/41 2021-08-21T15:00:39.780 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/41 2021-08-21T15:00:39.963 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/41 2021-08-21T15:00:40.152 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/41 2021-08-21T15:00:40.292 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/41 2021-08-21T15:00:40.454 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/41 2021-08-21T15:00:40.604 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/41 2021-08-21T15:00:40.776 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/41 2021-08-21T15:00:40.964 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/41 2021-08-21T15:00:41.234 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/41 2021-08-21T15:00:41.449 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 13/41 2021-08-21T15:00:41.718 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/41 2021-08-21T15:00:42.078 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-08-21T15:00:42.310 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-3.2.1-4.el8.x86_64 16/41 2021-08-21T15:00:42.513 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 17/41 2021-08-21T15:00:42.716 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 18/41 2021-08-21T15:00:42.907 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 19/41 2021-08-21T15:00:43.124 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 20/41 2021-08-21T15:00:43.319 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 21/41 2021-08-21T15:00:43.559 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 22/41 2021-08-21T15:00:43.767 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/41 2021-08-21T15:00:44.011 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 24/41 2021-08-21T15:00:44.219 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 25/41 2021-08-21T15:00:44.592 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 26/41 2021-08-21T15:00:44.820 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-lxml-4.2.3-2.el8.x86_64 27/41 2021-08-21T15:00:45.012 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 28/41 2021-08-21T15:00:45.191 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/41 2021-08-21T15:00:45.360 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 30/41 2021-08-21T15:00:45.616 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-2.6-1.el8.noarch 31/41 2021-08-21T15:00:45.801 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 32/41 2021-08-21T15:00:45.994 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/41 2021-08-21T15:00:46.351 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/41 2021-08-21T15:00:46.653 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 35/41 2021-08-21T15:00:46.988 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-7135.gcae1ffd5.el8. 36/41 2021-08-21T15:00:47.144 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:17.0.0-7135.gcae1ffd5.el8.x86_64 37/41 2021-08-21T15:00:48.741 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:17.0.0-7135.gcae1ffd5.el8.x86_64 37/41 2021-08-21T15:00:49.027 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 38/41 2021-08-21T15:00:49.416 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 38/41 2021-08-21T15:00:49.610 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:17.0.0-7135.gcae1ffd5.el8.x86_64 39/41 2021-08-21T15:00:49.824 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:17.0.0-7135.gcae1ffd5.el8.x86_64 39/41 2021-08-21T15:00:50.019 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:17.0.0-7135.gcae1ffd5.el8.x86_64 40/41 2021-08-21T15:00:50.114 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:17.0.0-7135.gcae1ffd5.el8.x86_64 40/41 2021-08-21T15:00:50.164 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:17.0.0-7135.gcae1ffd5.el8.x86_64 41/41 2021-08-21T15:00:50.537 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-2:17.0.0-7135.gcae1ffd5.el8.x86_64 41/41 2021-08-21T15:00:50.538 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/41 2021-08-21T15:00:50.538 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2/41 2021-08-21T15:00:50.538 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:17.0.0-7135.gcae1ffd5.el8.x86_64 3/41 2021-08-21T15:00:50.539 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:17.0.0-7135.gcae1ffd5.el8.x86_64 4/41 2021-08-21T15:00:50.539 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 5/41 2021-08-21T15:00:50.539 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-7135.gcae1ffd5.el8. 6/41 2021-08-21T15:00:50.539 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/41 2021-08-21T15:00:50.539 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-lxml-4.2.3-2.el8.x86_64 8/41 2021-08-21T15:00:50.540 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/41 2021-08-21T15:00:50.540 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/41 2021-08-21T15:00:50.540 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 11/41 2021-08-21T15:00:50.540 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/41 2021-08-21T15:00:50.541 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/41 2021-08-21T15:00:50.541 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/41 2021-08-21T15:00:50.541 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-08-21T15:00:50.541 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 16/41 2021-08-21T15:00:50.541 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-3.2.1-4.el8.x86_64 17/41 2021-08-21T15:00:50.542 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-idna-2.5-5.el8.noarch 18/41 2021-08-21T15:00:50.542 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 19/41 2021-08-21T15:00:50.542 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 20/41 2021-08-21T15:00:50.542 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 21/41 2021-08-21T15:00:50.542 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 22/41 2021-08-21T15:00:50.543 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 23/41 2021-08-21T15:00:50.543 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/41 2021-08-21T15:00:50.543 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 25/41 2021-08-21T15:00:50.543 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 26/41 2021-08-21T15:00:50.544 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 27/41 2021-08-21T15:00:50.544 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 28/41 2021-08-21T15:00:50.544 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 29/41 2021-08-21T15:00:50.544 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 30/41 2021-08-21T15:00:50.544 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 31/41 2021-08-21T15:00:50.546 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 32/41 2021-08-21T15:00:50.546 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-2.6-1.el8.noarch 33/41 2021-08-21T15:00:50.546 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 34/41 2021-08-21T15:00:50.547 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 35/41 2021-08-21T15:00:50.547 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 36/41 2021-08-21T15:00:50.547 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 37/41 2021-08-21T15:00:50.547 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 38/41 2021-08-21T15:00:50.548 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 39/41 2021-08-21T15:00:50.548 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 40/41 2021-08-21T15:00:51.484 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 41/41 2021-08-21T15:00:51.484 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:51.484 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:00:51.484 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:51.485 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:51.485 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:51.485 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:17.0.0-7135.gcae1ffd5.el8.noarch 2021-08-21T15:00:51.485 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:51.486 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:00:51.486 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-08-21T15:00:51.486 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-08-21T15:00:51.486 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-08-21T15:00:51.487 INFO:teuthology.orchestra.run.smithi173.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-08-21T15:00:51.487 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-08-21T15:00:51.487 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-08-21T15:00:51.487 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-3.2.1-4.el8.x86_64 2021-08-21T15:00:51.487 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-08-21T15:00:51.488 INFO:teuthology.orchestra.run.smithi173.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-08-21T15:00:51.488 INFO:teuthology.orchestra.run.smithi173.stdout: python3-idna-2.5-5.el8.noarch 2021-08-21T15:00:51.488 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-6.2-6.el8.noarch 2021-08-21T15:00:51.489 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-08-21T15:00:51.489 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-08-21T15:00:51.489 INFO:teuthology.orchestra.run.smithi173.stdout: python3-lxml-4.2.3-2.el8.x86_64 2021-08-21T15:00:51.489 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.0.6-13.el8.noarch 2021-08-21T15:00:51.490 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-08-21T15:00:51.490 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-08-21T15:00:51.490 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-08-21T15:00:51.490 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-2.6-1.el8.noarch 2021-08-21T15:00:51.490 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-08-21T15:00:51.491 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.14-14.el8.noarch 2021-08-21T15:00:51.491 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-08-21T15:00:51.491 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2017.2-9.el8.noarch 2021-08-21T15:00:51.491 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-08-21T15:00:51.492 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-08-21T15:00:51.492 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-08-21T15:00:51.492 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-08-21T15:00:51.492 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-08-21T15:00:51.492 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-08-21T15:00:51.493 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-08-21T15:00:51.493 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-08-21T15:00:51.493 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-08-21T15:00:51.493 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-08-21T15:00:51.494 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-08-21T15:00:51.494 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-08-21T15:00:51.494 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:51.495 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:00:51.688 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base 2021-08-21T15:00:52.140 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:05 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:00:52.839 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:00:53.091 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:00:53.091 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:00:53.092 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:00:53.144 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install cephadm 2021-08-21T15:00:53.587 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:06 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:00:54.532 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:00:54.532 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:54.533 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T15:00:54.533 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:54.533 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:00:54.534 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:17.0.0-7135.gcae1ffd5.el8 ceph-noarch 69 k 2021-08-21T15:00:54.534 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:54.534 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:00:54.535 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:54.535 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2021-08-21T15:00:54.535 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:54.536 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 69 k 2021-08-21T15:00:54.536 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 308 k 2021-08-21T15:00:54.537 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:00:54.663 INFO:teuthology.orchestra.run.smithi173.stdout:cephadm-17.0.0-7135.gcae1ffd5.el8.noarch.rpm 527 kB/s | 69 kB 00:00 2021-08-21T15:00:54.664 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:00:54.665 INFO:teuthology.orchestra.run.smithi173.stdout:Total 522 kB/s | 69 kB 00:00 2021-08-21T15:00:54.665 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:00:54.671 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:00:54.671 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:00:54.673 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:00:54.676 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:00:54.726 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:00:56.860 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 1/1 2021-08-21T15:00:57.105 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 1/1 2021-08-21T15:00:57.295 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 1/1 2021-08-21T15:00:57.572 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 1/1 2021-08-21T15:00:57.572 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:57.572 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:00:57.573 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 2021-08-21T15:00:57.573 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:57.573 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:00:57.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache 2021-08-21T15:00:58.192 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:11 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:00:59.137 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:00:59.138 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:59.138 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2021-08-21T15:00:59.138 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:59.138 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:00:59.139 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 169 k 2021-08-21T15:00:59.139 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:59.139 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:00:59.140 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:00:59.140 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2021-08-21T15:00:59.140 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:00:59.141 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 169 k 2021-08-21T15:00:59.141 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 567 k 2021-08-21T15:00:59.141 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:00:59.312 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-17.0.0-7135.gcae1ff 974 kB/s | 169 kB 00:00 2021-08-21T15:00:59.313 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:00:59.313 INFO:teuthology.orchestra.run.smithi173.stdout:Total 967 kB/s | 169 kB 00:00 2021-08-21T15:00:59.314 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:00:59.325 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:00:59.325 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:00:59.372 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:00:59.375 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:00:59.553 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:00.570 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-7135.gcae1ffd5. 1/1 2021-08-21T15:01:00.953 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-7135.gcae1ffd5. 1/1 2021-08-21T15:01:01.214 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-7135.gcae1ffd5. 1/1 2021-08-21T15:01:01.214 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:01.214 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:01.215 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:01:01.215 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:01.215 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:01.336 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr 2021-08-21T15:01:01.792 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:14 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:02.512 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-mgr-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:01:02.765 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:02.766 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:01:02.767 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:02.826 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-dashboard 2021-08-21T15:01:03.268 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:16 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:04.226 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:04.227 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:04.227 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T15:01:04.227 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:04.227 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:04.228 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:17.0.0-7135.gcae1ffd5.el8 ceph-noarch 1.5 M 2021-08-21T15:01:04.228 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T15:01:04.228 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:17.0.0-7135.gcae1ffd5.el8 ceph-noarch 24 k 2021-08-21T15:01:04.228 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:17.0.0-7135.gcae1ffd5.el8 ceph-noarch 8.9 k 2021-08-21T15:01:04.229 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-08-21T15:01:04.229 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-08-21T15:01:04.229 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-08-21T15:01:04.229 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:04.229 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:04.230 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:04.230 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2021-08-21T15:01:04.230 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:04.231 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.8 M 2021-08-21T15:01:04.231 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 7.4 M 2021-08-21T15:01:04.231 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:04.438 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): ceph-prometheus-alerts-17.0.0-7135.gcae1 43 kB/s | 8.9 kB 00:00 2021-08-21T15:01:04.468 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-08-21T15:01:04.487 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): ceph-grafana-dashboards-17.0.0-7135.gcae 93 kB/s | 24 kB 00:00 2021-08-21T15:01:04.534 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 513 kB/s | 34 kB 00:00 2021-08-21T15:01:04.643 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2021-08-21T15:01:05.131 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): ceph-mgr-dashboard-17.0.0-7135.gcae1ffd5 1.7 MB/s | 1.5 MB 00:00 2021-08-21T15:01:05.133 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:05.134 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.0 MB/s | 1.8 MB 00:00 2021-08-21T15:01:05.135 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:05.143 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:05.144 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:05.213 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:05.216 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:05.470 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:06.537 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-08-21T15:01:06.871 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-08-21T15:01:07.096 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-08-21T15:01:07.268 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-7135.gcae1ffd5.el8.n 4/6 2021-08-21T15:01:07.624 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-7135.gcae1ffd5.el8. 5/6 2021-08-21T15:01:07.865 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-7135.gcae1ffd5.el8.noarc 6/6 2021-08-21T15:01:08.105 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-7135.gcae1ffd5.el8.noarc 6/6 2021-08-21T15:01:08.106 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-7135.gcae1ffd5.el8. 1/6 2021-08-21T15:01:08.106 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-7135.gcae1ffd5.el8.noarc 2/6 2021-08-21T15:01:08.106 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-7135.gcae1ffd5.el8.n 3/6 2021-08-21T15:01:08.106 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-08-21T15:01:08.107 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-08-21T15:01:08.395 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-08-21T15:01:08.395 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:08.396 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:08.396 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:17.0.0-7135.gcae1ffd5.el8.noarch 2021-08-21T15:01:08.396 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:17.0.0-7135.gcae1ffd5.el8.noarch 2021-08-21T15:01:08.396 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:17.0.0-7135.gcae1ffd5.el8.noarch 2021-08-21T15:01:08.396 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-08-21T15:01:08.397 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-08-21T15:01:08.397 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.4.1-12.el8.noarch 2021-08-21T15:01:08.397 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:08.397 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:08.464 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-diskprediction-local 2021-08-21T15:01:08.907 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:21 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:09.850 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:09.851 INFO:teuthology.orchestra.run.smithi173.stdout:===================================================================================================== 2021-08-21T15:01:09.851 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T15:01:09.852 INFO:teuthology.orchestra.run.smithi173.stdout:===================================================================================================== 2021-08-21T15:01:09.852 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:09.852 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-7135.gcae1ffd5.el8 ceph-noarch 7.4 M 2021-08-21T15:01:09.852 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T15:01:09.852 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 8.4.1-1.el8 CentOS-Base 639 k 2021-08-21T15:01:09.853 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 8.4.1-1.el8 CentOS-Base 169 k 2021-08-21T15:01:09.853 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-08-21T15:01:09.854 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-08-21T15:01:09.856 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-08-21T15:01:09.856 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-08-21T15:01:09.857 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.0.0-20.module_el8.4.0+790+083e3d81 CentOS-AppStream 15 M 2021-08-21T15:01:09.858 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:09.858 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:09.858 INFO:teuthology.orchestra.run.smithi173.stdout:===================================================================================================== 2021-08-21T15:01:09.859 INFO:teuthology.orchestra.run.smithi173.stdout:Install 8 Packages 2021-08-21T15:01:09.859 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:09.860 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 36 M 2021-08-21T15:01:09.860 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 197 M 2021-08-21T15:01:09.861 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:09.955 INFO:teuthology.orchestra.run.smithi173.stdout:(1/8): openblas-0.3.12-1.el8.x86_64.rpm 45 MB/s | 4.6 MB 00:00 2021-08-21T15:01:10.008 INFO:teuthology.orchestra.run.smithi173.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 71 MB/s | 3.7 MB 00:00 2021-08-21T15:01:10.015 INFO:teuthology.orchestra.run.smithi173.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 30 MB/s | 225 kB 00:00 2021-08-21T15:01:10.177 INFO:teuthology.orchestra.run.smithi173.stdout:(4/8): openblas-threads-0.3.12-1.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2021-08-21T15:01:10.213 INFO:teuthology.orchestra.run.smithi173.stdout:(5/8): libgfortran-8.4.1-1.el8.x86_64.rpm 17 MB/s | 639 kB 00:00 2021-08-21T15:01:10.226 INFO:teuthology.orchestra.run.smithi173.stdout:(6/8): libquadmath-8.4.1-1.el8.x86_64.rpm 13 MB/s | 169 kB 00:00 2021-08-21T15:01:10.346 INFO:teuthology.orchestra.run.smithi173.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.4.0+79 44 MB/s | 15 MB 00:00 2021-08-21T15:01:10.372 INFO:teuthology.orchestra.run.smithi173.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-713 14 MB/s | 7.4 MB 00:00 2021-08-21T15:01:10.374 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:10.374 INFO:teuthology.orchestra.run.smithi173.stdout:Total 69 MB/s | 36 MB 00:00 2021-08-21T15:01:10.383 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:10.405 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:10.405 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:10.753 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:10.757 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:11.321 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:11.493 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 1/8 2021-08-21T15:01:11.630 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 1/8 2021-08-21T15:01:11.926 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 2/8 2021-08-21T15:01:12.450 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 2/8 2021-08-21T15:01:12.601 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/8 2021-08-21T15:01:13.129 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/8 2021-08-21T15:01:13.259 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-08-21T15:01:13.956 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/8 2021-08-21T15:01:14.299 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-08-21T15:01:14.542 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-08-21T15:01:16.529 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-08-21T15:01:17.810 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 7/8 2021-08-21T15:01:18.000 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-7135.gcae1ffd 8/8 2021-08-21T15:01:18.271 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-7135.gcae1ffd 8/8 2021-08-21T15:01:18.272 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-7135.gcae1ffd 1/8 2021-08-21T15:01:18.272 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/8 2021-08-21T15:01:18.272 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/8 2021-08-21T15:01:18.272 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-08-21T15:01:18.273 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-08-21T15:01:18.273 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x 6/8 2021-08-21T15:01:18.273 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 7/8 2021-08-21T15:01:18.568 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 8/8 2021-08-21T15:01:18.568 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:18.569 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:17.0.0-7135.gcae1ffd5.el8.noarch 2021-08-21T15:01:18.569 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-8.4.1-1.el8.x86_64 2021-08-21T15:01:18.570 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-8.4.1-1.el8.x86_64 2021-08-21T15:01:18.570 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.12-1.el8.x86_64 2021-08-21T15:01:18.570 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-08-21T15:01:18.570 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-08-21T15:01:18.571 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-08-21T15:01:18.571 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.0.0-20.module_el8.4.0+790+083e3d81.x86_64 2021-08-21T15:01:18.572 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:18.635 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-rook 2021-08-21T15:01:19.078 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:20.035 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:20.037 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2021-08-21T15:01:20.037 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T15:01:20.037 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2021-08-21T15:01:20.037 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:20.037 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:17.0.0-7135.gcae1ffd5.el8 ceph-noarch 43 k 2021-08-21T15:01:20.038 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T15:01:20.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-08-21T15:01:20.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-08-21T15:01:20.038 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-08-21T15:01:20.039 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-08-21T15:01:20.039 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-08-21T15:01:20.039 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-08-21T15:01:20.039 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-08-21T15:01:20.039 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-08-21T15:01:20.040 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-08-21T15:01:20.040 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-08-21T15:01:20.040 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-08-21T15:01:20.041 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-08-21T15:01:20.041 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:20.041 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:20.041 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2021-08-21T15:01:20.041 INFO:teuthology.orchestra.run.smithi173.stdout:Install 13 Packages 2021-08-21T15:01:20.042 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:20.043 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.9 M 2021-08-21T15:01:20.043 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 25 M 2021-08-21T15:01:20.043 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:20.074 INFO:teuthology.orchestra.run.smithi173.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 781 kB/s | 27 kB 00:00 2021-08-21T15:01:20.075 INFO:teuthology.orchestra.run.smithi173.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 574 kB/s | 20 kB 00:00 2021-08-21T15:01:20.077 INFO:teuthology.orchestra.run.smithi173.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 42 MB/s | 126 kB 00:00 2021-08-21T15:01:20.078 INFO:teuthology.orchestra.run.smithi173.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 37 MB/s | 110 kB 00:00 2021-08-21T15:01:20.079 INFO:teuthology.orchestra.run.smithi173.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 29 MB/s | 43 kB 00:00 2021-08-21T15:01:20.080 INFO:teuthology.orchestra.run.smithi173.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 48 MB/s | 155 kB 00:00 2021-08-21T15:01:20.147 INFO:teuthology.orchestra.run.smithi173.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 487 kB/s | 33 kB 00:00 2021-08-21T15:01:20.161 INFO:teuthology.orchestra.run.smithi173.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 203 kB/s | 16 kB 00:00 2021-08-21T15:01:20.189 INFO:teuthology.orchestra.run.smithi173.stdout:(9/13): ceph-mgr-rook-17.0.0-7135.gcae1ffd5.el8 286 kB/s | 43 kB 00:00 2021-08-21T15:01:20.192 INFO:teuthology.orchestra.run.smithi173.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.8 MB/s | 81 kB 00:00 2021-08-21T15:01:20.215 INFO:teuthology.orchestra.run.smithi173.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.6 MB/s | 61 kB 00:00 2021-08-21T15:01:20.275 INFO:teuthology.orchestra.run.smithi173.stdout:(12/13): python3-rsa-3.4.2-16.el8.noarch.rpm 859 kB/s | 73 kB 00:00 2021-08-21T15:01:20.355 INFO:teuthology.orchestra.run.smithi173.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 6.0 MB/s | 1.2 MB 00:00 2021-08-21T15:01:20.357 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:20.357 INFO:teuthology.orchestra.run.smithi173.stdout:Total 6.1 MB/s | 1.9 MB 00:00 2021-08-21T15:01:20.362 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:20.377 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:20.378 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:20.451 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:20.456 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:20.946 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:21.197 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-08-21T15:01:21.422 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-08-21T15:01:21.639 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-08-21T15:01:21.849 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-08-21T15:01:22.056 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-08-21T15:01:22.262 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-08-21T15:01:23.103 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-08-21T15:01:23.487 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-08-21T15:01:24.584 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-08-21T15:01:24.840 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-08-21T15:01:25.031 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-08-21T15:01:25.233 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-08-21T15:01:25.433 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:17.0.0-7135.gcae1ffd5.el8.noarch 13/13 2021-08-21T15:01:25.677 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-7135.gcae1ffd5.el8.noarch 13/13 2021-08-21T15:01:25.678 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:17.0.0-7135.gcae1ffd5.el8.noarch 1/13 2021-08-21T15:01:25.678 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-08-21T15:01:25.679 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-08-21T15:01:25.679 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-08-21T15:01:25.679 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-08-21T15:01:25.680 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-08-21T15:01:25.680 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-08-21T15:01:25.681 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-08-21T15:01:25.681 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-08-21T15:01:25.681 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-08-21T15:01:25.682 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-08-21T15:01:25.682 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-08-21T15:01:26.017 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-08-21T15:01:26.017 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:26.017 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:26.018 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:17.0.0-7135.gcae1ffd5.el8.noarch 2021-08-21T15:01:26.018 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-08-21T15:01:26.018 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-08-21T15:01:26.019 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-08-21T15:01:26.019 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-08-21T15:01:26.020 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-08-21T15:01:26.020 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-08-21T15:01:26.021 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-08-21T15:01:26.021 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-08-21T15:01:26.021 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-08-21T15:01:26.021 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-08-21T15:01:26.022 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-08-21T15:01:26.022 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-08-21T15:01:26.022 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:26.022 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:26.116 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-cephadm 2021-08-21T15:01:26.562 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:27.509 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:27.509 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:27.510 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T15:01:27.510 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:27.510 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:27.510 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:17.0.0-7135.gcae1ffd5.el8 ceph-noarch 91 k 2021-08-21T15:01:27.511 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T15:01:27.511 INFO:teuthology.orchestra.run.smithi173.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-08-21T15:01:27.511 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-08-21T15:01:27.511 INFO:teuthology.orchestra.run.smithi173.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-08-21T15:01:27.512 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-08-21T15:01:27.512 INFO:teuthology.orchestra.run.smithi173.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-08-21T15:01:27.512 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:27.512 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:27.512 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:27.513 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2021-08-21T15:01:27.513 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:27.514 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 5.8 M 2021-08-21T15:01:27.514 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 24 M 2021-08-21T15:01:27.514 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:27.559 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 11 MB/s | 538 kB 00:00 2021-08-21T15:01:27.613 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 48 MB/s | 4.8 MB 00:00 2021-08-21T15:01:27.623 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 329 kB/s | 21 kB 00:00 2021-08-21T15:01:27.661 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): ceph-mgr-cephadm-17.0.0-7135.gcae1ffd5.e 609 kB/s | 91 kB 00:00 2021-08-21T15:01:27.666 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 1.1 MB/s | 48 kB 00:00 2021-08-21T15:01:27.742 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.7 MB/s | 355 kB 00:00 2021-08-21T15:01:27.744 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:27.745 INFO:teuthology.orchestra.run.smithi173.stdout:Total 25 MB/s | 5.8 MB 00:00 2021-08-21T15:01:27.747 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:27.756 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:27.756 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:27.838 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:27.841 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:28.107 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:28.386 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-08-21T15:01:28.896 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-08-21T15:01:29.836 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-08-21T15:01:30.242 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-08-21T15:01:30.497 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-08-21T15:01:30.698 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 6/6 2021-08-21T15:01:30.924 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 6/6 2021-08-21T15:01:30.925 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 1/6 2021-08-21T15:01:30.925 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-08-21T15:01:30.925 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-08-21T15:01:30.926 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-08-21T15:01:30.926 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-08-21T15:01:31.216 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-08-21T15:01:31.217 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:31.217 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:31.218 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:17.0.0-7135.gcae1ffd5.el8.noarch 2021-08-21T15:01:31.218 INFO:teuthology.orchestra.run.smithi173.stdout: python3-apipkg-1.5-6.el8.noarch 2021-08-21T15:01:31.218 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.5.1-5.el8.noarch 2021-08-21T15:01:31.219 INFO:teuthology.orchestra.run.smithi173.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-08-21T15:01:31.219 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-08-21T15:01:31.220 INFO:teuthology.orchestra.run.smithi173.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-08-21T15:01:31.221 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:31.222 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:31.300 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse 2021-08-21T15:01:31.749 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:32.711 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:32.712 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:32.712 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2021-08-21T15:01:32.713 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:32.713 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:32.713 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 868 k 2021-08-21T15:01:32.713 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2021-08-21T15:01:32.714 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-08-21T15:01:32.714 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:32.714 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:32.715 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:32.715 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2021-08-21T15:01:32.716 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:32.716 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 951 k 2021-08-21T15:01:32.716 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 3.1 M 2021-08-21T15:01:32.717 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:32.745 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 82 kB 00:00 2021-08-21T15:01:33.297 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-fuse-17.0.0-7135.gcae1ffd5.el8.x86_ 1.5 MB/s | 868 kB 00:00 2021-08-21T15:01:33.297 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:33.298 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.6 MB/s | 951 kB 00:00 2021-08-21T15:01:33.299 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:33.331 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:33.331 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:33.397 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:33.400 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:33.566 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:33.832 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-08-21T15:01:34.056 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2/2 2021-08-21T15:01:34.402 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2/2 2021-08-21T15:01:34.403 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/2 2021-08-21T15:01:34.732 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-08-21T15:01:34.732 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:34.732 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:34.733 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-08-21T15:01:34.733 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:34.733 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:34.893 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel 2021-08-21T15:01:35.348 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:36.303 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:36.304 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:36.304 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2021-08-21T15:01:36.304 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:36.304 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:36.305 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 125 k 2021-08-21T15:01:36.305 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:36.305 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:36.305 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:36.306 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2021-08-21T15:01:36.306 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:36.306 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 125 k 2021-08-21T15:01:36.306 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 432 k 2021-08-21T15:01:36.306 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:36.456 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-17.0.0-7135.gcae1ffd5.el8.x86_64 822 kB/s | 125 kB 00:00 2021-08-21T15:01:36.458 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:36.458 INFO:teuthology.orchestra.run.smithi173.stdout:Total 815 kB/s | 125 kB 00:00 2021-08-21T15:01:36.459 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:36.463 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:36.464 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:36.515 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:36.518 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:36.642 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:36.820 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:37.069 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:37.348 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:37.348 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:37.349 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:37.349 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:01:37.349 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:37.349 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:37.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2 2021-08-21T15:01:37.926 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:50 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:38.631 INFO:teuthology.orchestra.run.smithi173.stdout:Package libcephfs2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:01:38.889 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:38.890 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:01:38.891 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:38.953 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs-devel 2021-08-21T15:01:39.397 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:52 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:40.363 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:40.364 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:40.365 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2021-08-21T15:01:40.365 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:40.365 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:40.366 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 24 k 2021-08-21T15:01:40.366 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:40.366 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:40.366 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:40.367 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2021-08-21T15:01:40.367 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:40.367 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 24 k 2021-08-21T15:01:40.368 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 102 k 2021-08-21T15:01:40.368 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:40.489 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs-devel-17.0.0-7135.gcae1ffd5.el8.x86_6 193 kB/s | 24 kB 00:00 2021-08-21T15:01:40.490 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:40.491 INFO:teuthology.orchestra.run.smithi173.stdout:Total 191 kB/s | 24 kB 00:00 2021-08-21T15:01:40.491 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:40.494 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:40.494 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:40.496 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:40.498 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:40.553 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:40.737 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:40.957 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:41.206 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:41.206 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:41.207 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:41.207 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:01:41.207 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:41.207 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:41.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2 2021-08-21T15:01:41.732 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:54 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:42.456 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:01:42.705 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:42.705 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:01:42.706 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:42.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1 2021-08-21T15:01:43.211 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:56 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:43.944 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:01:44.192 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:44.193 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:01:44.193 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:44.260 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados 2021-08-21T15:01:44.703 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:57 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:45.729 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rados-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:01:45.979 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:45.980 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:01:45.981 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:46.191 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw 2021-08-21T15:01:46.635 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:59 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:47.355 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rgw-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:01:47.603 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:47.604 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:01:47.605 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:47.666 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs 2021-08-21T15:01:48.110 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:01 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:48.821 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-cephfs-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:01:49.069 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:49.070 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:01:49.070 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:49.132 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd 2021-08-21T15:01:49.578 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:02 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:50.271 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rbd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 is already installed. 2021-08-21T15:01:50.523 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:50.524 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2021-08-21T15:01:50.524 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:50.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse 2021-08-21T15:01:51.027 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:04 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:52.111 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:52.112 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:52.113 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2021-08-21T15:01:52.113 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:52.113 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:52.114 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 93 k 2021-08-21T15:01:52.114 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:52.114 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:52.115 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:52.115 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2021-08-21T15:01:52.115 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:52.115 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 93 k 2021-08-21T15:01:52.116 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 281 k 2021-08-21T15:01:52.116 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:52.282 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-17.0.0-7135.gcae1ffd5.el8.x86_64.rpm 552 kB/s | 93 kB 00:00 2021-08-21T15:01:52.283 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:52.283 INFO:teuthology.orchestra.run.smithi173.stdout:Total 547 kB/s | 93 kB 00:00 2021-08-21T15:01:52.283 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:52.294 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:52.294 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:52.345 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:52.348 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:52.460 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:52.655 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:52.896 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:53.164 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:53.165 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:53.165 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:53.165 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:01:53.165 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:53.166 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:53.320 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror 2021-08-21T15:01:53.771 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:06 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:54.730 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:54.731 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:54.731 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2021-08-21T15:01:54.732 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:54.732 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:54.732 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 3.8 M 2021-08-21T15:01:54.732 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:54.733 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:54.733 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:54.733 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2021-08-21T15:01:54.733 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:54.733 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 3.8 M 2021-08-21T15:01:54.734 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 19 M 2021-08-21T15:01:54.734 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:55.046 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-17.0.0-7135.gcae1ffd5.el8.x86_64.rpm 12 MB/s | 3.8 MB 00:00 2021-08-21T15:01:55.047 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:55.047 INFO:teuthology.orchestra.run.smithi173.stdout:Total 12 MB/s | 3.8 MB 00:00 2021-08-21T15:01:55.048 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:55.061 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:55.061 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:55.124 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:55.128 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:55.606 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:55.820 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:56.176 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:56.429 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:56.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:56.429 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:56.430 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:01:56.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:56.430 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:56.579 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd 2021-08-21T15:01:57.032 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:10 ago on Sat 21 Aug 2021 02:59:47 PM UTC. 2021-08-21T15:01:58.007 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2021-08-21T15:01:58.008 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:58.008 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2021-08-21T15:01:58.008 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:58.009 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2021-08-21T15:01:58.009 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:17.0.0-7135.gcae1ffd5.el8 ceph 172 k 2021-08-21T15:01:58.009 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:58.010 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2021-08-21T15:01:58.010 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2021-08-21T15:01:58.010 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2021-08-21T15:01:58.010 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:58.011 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 172 k 2021-08-21T15:01:58.011 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 563 k 2021-08-21T15:01:58.011 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2021-08-21T15:01:58.161 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-17.0.0-7135.gcae1ffd5.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2021-08-21T15:01:58.161 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2021-08-21T15:01:58.162 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.1 MB/s | 172 kB 00:00 2021-08-21T15:01:58.162 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2021-08-21T15:01:58.174 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2021-08-21T15:01:58.174 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2021-08-21T15:01:58.225 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2021-08-21T15:01:58.226 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2021-08-21T15:01:58.345 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2021-08-21T15:01:58.526 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:58.768 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:59.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 1/1 2021-08-21T15:01:59.058 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:59.059 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2021-08-21T15:01:59.059 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:17.0.0-7135.gcae1ffd5.el8.x86_64 2021-08-21T15:01:59.059 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:01:59.059 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2021-08-21T15:01:59.199 DEBUG:teuthology.parallel:result is None 2021-08-21T15:01:59.200 DEBUG:teuthology.orchestra.run.smithi173:> sudo lsb_release -is 2021-08-21T15:01:59.233 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS 2021-08-21T15:01:59.234 DEBUG:teuthology.misc:System to be installed: CentOS 2021-08-21T15:01:59.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cae1ffd55a16af4627c36508fde05bf24312fad6 2021-08-21T15:01:59.388 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-08-21T15:01:59.407 INFO:teuthology.orchestra.run.smithi173.stdout:17.0.0-7135.gcae1ffd5.el8 2021-08-21T15:01:59.408 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-7135.gcae1ffd5.el8 2021-08-21T15:01:59.409 INFO:teuthology.task.install:The correct ceph version 17.0.0-7135.gcae1ffd5 is installed. 2021-08-21T15:01:59.409 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-08-21T15:01:59.410 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:01:59.410 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-08-21T15:01:59.471 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-08-21T15:01:59.472 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:01:59.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2021-08-21T15:01:59.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-08-21T15:01:59.599 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-08-21T15:01:59.600 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:01:59.601 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2021-08-21T15:01:59.662 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-08-21T15:01:59.725 INFO:teuthology.run_tasks:Running task ceph... 2021-08-21T15:01:59.789 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-08-21T15:01:59.790 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2021-08-21T15:01:59.814 INFO:tasks.ceph:Disabling ceph logrotate... 2021-08-21T15:01:59.814 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2021-08-21T15:01:59.877 INFO:tasks.ceph:Creating extra log directories... 2021-08-21T15:01:59.878 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-08-21T15:01:59.949 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-08-21T15:01:59.949 INFO:tasks.ceph:config {'conf': {'osd': {'osd min pg log entries': 5, 'osd pg log trim min': 0, 'osd_fast_fail_on_connection_refused': False, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_DEGRADED\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-08-21T15:01:59.950 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi/6350483', 'branch': 'wip-yuri-master-8.20.21', 'description': 'rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6350483', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2021-08-21_14:21:15-rados-wip-yuri-master-8.20.21-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'wip-yuri-master-8.20.21'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-master-8.20.21', 'sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 51, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2']], 'sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri-master-8.20.21', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_cae1ffd55a16af4627c36508fde05bf24312fad6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6', 'targets': {'smithi173.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaBMNBgUp3Two/W82w9kbWZ1RP/7zy6svRd/qPZPQ1Cx9iTbpp3Q+Go8IBvRAQen6bNKLduYggSeXcTxij0pvKH66ikMaYCg7mPCLClO7fR2lh9CadflchxSXOPLGJbaCoUxKWDh+yOBs12iEjAe4gI1u8ltHEKpFzw9oRFHBU+0kcN4pMn6/VVoBvkiiztUKwQlddkxBfaurPXv0EW1lUjgG3cF62hgpCTtEP1HCb7+S8kcACcz0mI4llkzNXStv/B0ff1aI6tw4RIMG4XB8C7CvVC+XSAy3Cc2vMP15D9XO8Be6dzJ2dvYLcmTjfsr0k/vroujmqbSlX4m30P3SqystBe83PuQ3rPGpUU2w0VTtixXlTi6eTg5q62vFm4ZktQGD5ck8Ac9Jm2m+Jg+FuSGU/xKJaRkwf82Cwesb/uQGUR7G8HV9HdRNFlekcscsIx3yNr3plAGUoqKOfApRWCHMysfELwaH+mywF5Apv2tx+LSkfN5gW8OeCzXf5ycE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'osd min pg log entries': 5, 'osd pg log trim min': 0, 'osd_fast_fail_on_connection_refused': False, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'log-ignorelist': ['but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_DEGRADED\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'cae1ffd55a16af4627c36508fde05bf24312fad6', 'cluster': 'ceph'}}, {'osd_recovery': None}], 'teuthology_branch': 'master', 'teuthology_sha1': '321319b12ea4ff9b63c7655015a3156de2c3b279', 'timestamp': '2021-08-21_14:21:15', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-08-21T15:01:59.950 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-08-21T15:01:59.995 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2021-08-21T15:02:00.058 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:00.059 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2021-08-21T15:02:00.112 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-08-21T15:02:00.113 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-08-21T15:02:00.168 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-08-21T15:02:00.169 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-21T15:02:00.169 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 112356 Links: 1 2021-08-21T15:02:00.169 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-21T15:02:00.169 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2021-08-21T15:02:00.170 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2021-08-21 15:01:55.971997459 +0000 2021-08-21T15:02:00.170 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2021-08-21 14:59:03.533032976 +0000 2021-08-21T15:02:00.171 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2021-08-21 14:59:03.533032976 +0000 2021-08-21T15:02:00.171 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2021-08-21T15:02:00.178 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2021-08-21T15:02:00.178 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2021-08-21T15:02:00.178 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000245804 s, 2.1 MB/s 2021-08-21T15:02:00.181 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-08-21T15:02:00.235 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-08-21T15:02:00.235 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-21T15:02:00.236 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 115896 Links: 1 2021-08-21T15:02:00.236 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-21T15:02:00.236 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2021-08-21T15:02:00.236 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2021-08-21 15:01:55.971997459 +0000 2021-08-21T15:02:00.237 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2021-08-21 14:59:04.055021596 +0000 2021-08-21T15:02:00.237 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2021-08-21 14:59:04.055021596 +0000 2021-08-21T15:02:00.237 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2021-08-21T15:02:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2021-08-21T15:02:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2021-08-21T15:02:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000214089 s, 2.4 MB/s 2021-08-21T15:02:00.247 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-08-21T15:02:00.301 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-08-21T15:02:00.302 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-21T15:02:00.302 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 113579 Links: 1 2021-08-21T15:02:00.302 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-21T15:02:00.302 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2021-08-21T15:02:00.303 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2021-08-21 15:01:55.971997459 +0000 2021-08-21T15:02:00.303 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2021-08-21 14:59:04.380014512 +0000 2021-08-21T15:02:00.303 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2021-08-21 14:59:04.380014512 +0000 2021-08-21T15:02:00.303 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2021-08-21T15:02:00.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2021-08-21T15:02:00.311 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2021-08-21T15:02:00.311 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000187956 s, 2.7 MB/s 2021-08-21T15:02:00.313 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-08-21T15:02:00.368 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-08-21T15:02:00.369 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-08-21T15:02:00.369 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 110457 Links: 1 2021-08-21T15:02:00.369 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-08-21T15:02:00.370 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2021-08-21T15:02:00.370 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2021-08-21 15:01:55.971997459 +0000 2021-08-21T15:02:00.370 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2021-08-21 14:59:04.740006664 +0000 2021-08-21T15:02:00.370 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2021-08-21 14:59:04.740006664 +0000 2021-08-21T15:02:00.371 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2021-08-21T15:02:00.377 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2021-08-21T15:02:00.378 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2021-08-21T15:02:00.378 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000201382 s, 2.5 MB/s 2021-08-21T15:02:00.380 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-08-21T15:02:00.380 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2021-08-21T15:02:00.381 INFO:tasks.ceph:Generating config... 2021-08-21T15:02:00.382 INFO:tasks.ceph:[osd] osd min pg log entries = 5 2021-08-21T15:02:00.382 INFO:tasks.ceph:[osd] osd pg log trim min = 0 2021-08-21T15:02:00.383 INFO:tasks.ceph:[osd] osd_fast_fail_on_connection_refused = False 2021-08-21T15:02:00.383 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-08-21T15:02:00.383 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2021-08-21T15:02:00.384 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-08-21T15:02:00.384 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-08-21T15:02:00.384 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-08-21T15:02:00.385 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-08-21T15:02:00.385 INFO:tasks.ceph:[osd] debug ms = 1 2021-08-21T15:02:00.385 INFO:tasks.ceph:[osd] debug osd = 20 2021-08-21T15:02:00.386 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-08-21T15:02:00.386 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-08-21T15:02:00.386 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-08-21T15:02:00.387 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-08-21T15:02:00.387 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2021-08-21T15:02:00.387 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2021-08-21T15:02:00.387 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-08-21T15:02:00.388 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-08-21T15:02:00.388 INFO:tasks.ceph:[osd] osd op queue = debug_random 2021-08-21T15:02:00.388 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2021-08-21T15:02:00.389 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-08-21T15:02:00.389 INFO:tasks.ceph:[global] mon election default strategy = 1 2021-08-21T15:02:00.390 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2021-08-21T15:02:00.390 INFO:tasks.ceph:[global] ms type = async 2021-08-21T15:02:00.390 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-08-21T15:02:00.390 INFO:tasks.ceph:[mgr] debug ms = 1 2021-08-21T15:02:00.391 INFO:tasks.ceph:[mon] debug mon = 20 2021-08-21T15:02:00.391 INFO:tasks.ceph:[mon] debug ms = 1 2021-08-21T15:02:00.391 INFO:tasks.ceph:[mon] debug paxos = 20 2021-08-21T15:02:00.392 INFO:tasks.ceph:[mon] mon scrub interval = 300 2021-08-21T15:02:00.392 INFO:tasks.ceph:Setting up mon.a... 2021-08-21T15:02:00.392 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-08-21T15:02:00.489 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.keyring 2021-08-21T15:02:00.492 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-08-21T15:02:00.530 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-08-21T15:02:00.597 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.173'), ('mon.b', '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]'), ('mon.c', '[v2:172.21.15.173:3302,v1:172.21.15.173:6791]')] 2021-08-21T15:02:00.598 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790],[v2:172.21.15.173:3302,v1:172.21.15.173:6791]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'osd min pg log entries': 5, 'osd pg log trim min': 0, 'osd_fast_fail_on_connection_refused': False, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2021-08-21T15:02:00.603 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:00.603 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-08-21T15:02:00.651 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.173 --addv b '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]' --addv c '[v2:172.21.15.173:3302,v1:172.21.15.173:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2021-08-21T15:02:00.734 INFO:teuthology.orchestra.run.smithi173.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-08-21T15:02:00.735 INFO:teuthology.orchestra.run.smithi173.stdout:monmaptool: generated fsid 90c992ca-066c-4cb6-b72f-9d34f4a3b9cc 2021-08-21T15:02:00.735 INFO:teuthology.orchestra.run.smithi173.stdout:setting min_mon_release = octopus 2021-08-21T15:02:00.736 INFO:teuthology.orchestra.run.smithi173.stdout:epoch 0 2021-08-21T15:02:00.736 INFO:teuthology.orchestra.run.smithi173.stdout:fsid 90c992ca-066c-4cb6-b72f-9d34f4a3b9cc 2021-08-21T15:02:00.736 INFO:teuthology.orchestra.run.smithi173.stdout:last_changed 2021-08-21T15:02:00.734571+0000 2021-08-21T15:02:00.736 INFO:teuthology.orchestra.run.smithi173.stdout:created 2021-08-21T15:02:00.734571+0000 2021-08-21T15:02:00.737 INFO:teuthology.orchestra.run.smithi173.stdout:min_mon_release 15 (octopus) 2021-08-21T15:02:00.737 INFO:teuthology.orchestra.run.smithi173.stdout:election_strategy: 1 2021-08-21T15:02:00.737 INFO:teuthology.orchestra.run.smithi173.stdout:0: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.a 2021-08-21T15:02:00.737 INFO:teuthology.orchestra.run.smithi173.stdout:1: [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] mon.b 2021-08-21T15:02:00.738 INFO:teuthology.orchestra.run.smithi173.stdout:2: [v2:172.21.15.173:3302/0,v1:172.21.15.173:6791/0] mon.c 2021-08-21T15:02:00.738 INFO:teuthology.orchestra.run.smithi173.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-08-21T15:02:00.740 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-08-21T15:02:00.794 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 90c992ca-066c-4cb6-b72f-9d34f4a3b9cc... 2021-08-21T15:02:00.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-08-21T15:02:00.874 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2021-08-21T15:02:00.875 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2021-08-21T15:02:00.875 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-08-21T15:02:00.875 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2021-08-21T15:02:00.876 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.876 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2021-08-21T15:02:00.876 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.876 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2021-08-21T15:02:00.876 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.877 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2021-08-21T15:02:00.877 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2021-08-21T15:02:00.877 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.878 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2021-08-21T15:02:00.878 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2021-08-21T15:02:00.878 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.878 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2021-08-21T15:02:00.878 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2021-08-21T15:02:00.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.879 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2021-08-21T15:02:00.879 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2021-08-21T15:02:00.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.880 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2021-08-21T15:02:00.880 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.881 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2021-08-21T15:02:00.881 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2021-08-21T15:02:00.881 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2021-08-21T15:02:00.882 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2021-08-21T15:02:00.882 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2021-08-21T15:02:00.882 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2021-08-21T15:02:00.882 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2021-08-21T15:02:00.883 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-08-21T15:02:00.883 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2021-08-21T15:02:00.883 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2021-08-21T15:02:00.883 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.884 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-08-21T15:02:00.884 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.884 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2021-08-21T15:02:00.884 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2021-08-21T15:02:00.885 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2021-08-21T15:02:00.885 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2021-08-21T15:02:00.885 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2021-08-21T15:02:00.886 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790],[v2:172.21.15.173:3302,v1:172.21.15.173:6791]" 2021-08-21T15:02:00.886 INFO:teuthology.orchestra.run.smithi173.stdout: mon client directed command retry = 5 2021-08-21T15:02:00.886 INFO:teuthology.orchestra.run.smithi173.stdout: mon election default strategy = 1 2021-08-21T15:02:00.886 INFO:teuthology.orchestra.run.smithi173.stdout: ms inject socket failures = 5000 2021-08-21T15:02:00.887 INFO:teuthology.orchestra.run.smithi173.stdout: ms type = async 2021-08-21T15:02:00.887 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 90c992ca-066c-4cb6-b72f-9d34f4a3b9cc 2021-08-21T15:02:00.887 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.887 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2021-08-21T15:02:00.887 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2021-08-21T15:02:00.888 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.888 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2021-08-21T15:02:00.888 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2021-08-21T15:02:00.888 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.888 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2021-08-21T15:02:00.889 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2021-08-21T15:02:00.889 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.889 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2021-08-21T15:02:00.889 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2021-08-21T15:02:00.890 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2021-08-21T15:02:00.890 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.890 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2021-08-21T15:02:00.890 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2021-08-21T15:02:00.890 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.891 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2021-08-21T15:02:00.891 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.891 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2021-08-21T15:02:00.891 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.891 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2021-08-21T15:02:00.892 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.892 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2021-08-21T15:02:00.892 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2021-08-21T15:02:00.892 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.892 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2021-08-21T15:02:00.893 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2021-08-21T15:02:00.893 INFO:teuthology.orchestra.run.smithi173.stdout: osd min pg log entries = 5 2021-08-21T15:02:00.893 INFO:teuthology.orchestra.run.smithi173.stdout: osd pg log trim min = 0 2021-08-21T15:02:00.893 INFO:teuthology.orchestra.run.smithi173.stdout: osd_fast_fail_on_connection_refused = False 2021-08-21T15:02:00.894 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2021-08-21T15:02:00.894 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore compression algorithm = zlib 2021-08-21T15:02:00.894 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore compression mode = aggressive 2021-08-21T15:02:00.894 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2021-08-21T15:02:00.894 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 20 2021-08-21T15:02:00.895 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 20 2021-08-21T15:02:00.895 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2021-08-21T15:02:00.895 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2021-08-21T15:02:00.895 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2021-08-21T15:02:00.896 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2021-08-21T15:02:00.896 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2021-08-21T15:02:00.896 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2021-08-21T15:02:00.896 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify cached snaps = True 2021-08-21T15:02:00.896 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify missing on start = True 2021-08-21T15:02:00.897 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2021-08-21T15:02:00.897 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2021-08-21T15:02:00.898 INFO:teuthology.orchestra.run.smithi173.stdout: osd op queue = debug_random 2021-08-21T15:02:00.898 INFO:teuthology.orchestra.run.smithi173.stdout: osd op queue cut off = debug_random 2021-08-21T15:02:00.898 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.898 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2021-08-21T15:02:00.899 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2021-08-21T15:02:00.899 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2021-08-21T15:02:00.899 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2021-08-21T15:02:00.899 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2021-08-21T15:02:00.899 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2021-08-21T15:02:00.900 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2021-08-21T15:02:00.900 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2021-08-21T15:02:00.900 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.900 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2021-08-21T15:02:00.901 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2021-08-21T15:02:00.901 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2021-08-21T15:02:00.901 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2021-08-21T15:02:00.901 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2021-08-21T15:02:00.901 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2021-08-21T15:02:00.902 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2021-08-21T15:02:00.902 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2021-08-21T15:02:00.902 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2021-08-21T15:02:00.902 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2021-08-21T15:02:00.902 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2021-08-21T15:02:00.903 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.903 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-08-21T15:02:00.903 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2021-08-21T15:02:00.903 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2021-08-21T15:02:00.903 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.904 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2021-08-21T15:02:00.904 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-08-21T15:02:00.904 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-08-21T15:02:00.904 INFO:teuthology.orchestra.run.smithi173.stdout: mon scrub interval = 300 2021-08-21T15:02:00.904 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:00.905 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2021-08-21T15:02:00.905 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2021-08-21T15:02:00.905 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2021-08-21T15:02:00.905 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2021-08-21T15:02:00.906 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-08-21T15:02:00.906 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-08-21T15:02:00.906 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2021-08-21T15:02:00.906 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2021-08-21T15:02:00.906 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2021-08-21T15:02:00.908 INFO:tasks.ceph:Creating admin key on mon.a... 2021-08-21T15:02:00.908 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-08-21T15:02:00.996 INFO:tasks.ceph:Copying monmap to all nodes... 2021-08-21T15:02:00.997 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:00.997 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-08-21T15:02:01.011 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:01.012 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-08-21T15:02:01.067 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2021-08-21T15:02:01.068 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:01.069 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2021-08-21T15:02:01.070 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-08-21T15:02:01.140 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:01.141 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-08-21T15:02:01.195 INFO:tasks.ceph:Setting up mon nodes... 2021-08-21T15:02:01.196 INFO:tasks.ceph:Setting up mgr nodes... 2021-08-21T15:02:01.196 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-08-21T15:02:01.280 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-08-21T15:02:01.283 INFO:tasks.ceph:Setting up mds nodes... 2021-08-21T15:02:01.283 INFO:tasks.ceph_client:Setting up client nodes... 2021-08-21T15:02:01.283 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-08-21T15:02:01.284 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2021-08-21T15:02:01.284 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-08-21T15:02:01.308 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-08-21T15:02:01.309 INFO:tasks.ceph:role: osd.0 2021-08-21T15:02:01.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2021-08-21T15:02:01.310 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-08-21T15:02:01.379 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-08-21T15:02:01.379 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-21T15:02:01.379 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-21T15:02:01.379 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2021-08-21T15:02:01.380 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-21T15:02:01.380 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2021-08-21T15:02:01.380 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-21T15:02:01.380 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-21T15:02:01.381 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-21T15:02:01.381 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-21T15:02:01.742 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2021-08-21T15:02:01.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2021-08-21T15:02:01.744 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-08-21T15:02:01.892 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-08-21T15:02:01.928 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-08-21T15:02:01.996 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-08-21T15:02:01.997 INFO:tasks.ceph:role: osd.1 2021-08-21T15:02:01.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2021-08-21T15:02:01.999 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-08-21T15:02:02.070 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-08-21T15:02:02.071 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-21T15:02:02.071 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-21T15:02:02.071 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2021-08-21T15:02:02.077 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-21T15:02:02.077 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2021-08-21T15:02:02.078 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-21T15:02:02.078 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-21T15:02:02.078 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-21T15:02:02.079 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-21T15:02:02.426 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2021-08-21T15:02:02.428 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2021-08-21T15:02:02.428 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-08-21T15:02:02.513 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-08-21T15:02:02.580 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-08-21T15:02:02.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-08-21T15:02:02.646 INFO:tasks.ceph:role: osd.2 2021-08-21T15:02:02.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2021-08-21T15:02:02.647 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-08-21T15:02:02.720 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-08-21T15:02:02.720 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2021-08-21T15:02:02.720 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-08-21T15:02:02.721 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 2021-08-21T15:02:02.721 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-08-21T15:02:02.721 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2021-08-21T15:02:02.721 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-08-21T15:02:02.722 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-08-21T15:02:02.722 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-08-21T15:02:02.722 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-08-21T15:02:03.092 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2021-08-21T15:02:03.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2021-08-21T15:02:03.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-08-21T15:02:03.197 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-08-21T15:02:03.225 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-21T15:02:03.318 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:03.317+0000 7f0b2f9420c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-08-21T15:02:03.322 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:03.321+0000 7f0b2f9420c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-08-21T15:02:03.322 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:03.321+0000 7f0b2f9420c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-08-21T15:02:03.322 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:03.321+0000 7f0b2f9420c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-08-21T15:02:03.323 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:03.321+0000 7f0b2f9420c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-08-21T15:02:03.323 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:03.322+0000 7f0b2f9420c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-08-21T15:02:06.166 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-08-21T15:02:06.194 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-21T15:02:06.277 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:06.276+0000 7f2fec4f60c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-08-21T15:02:06.278 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:06.276+0000 7f2fec4f60c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-08-21T15:02:06.278 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:06.276+0000 7f2fec4f60c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-08-21T15:02:06.279 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:06.276+0000 7f2fec4f60c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-08-21T15:02:06.279 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:06.276+0000 7f2fec4f60c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-08-21T15:02:06.279 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:06.276+0000 7f2fec4f60c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-08-21T15:02:09.135 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-08-21T15:02:09.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-08-21T15:02:09.290 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:09.289+0000 7fee8b96d0c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-08-21T15:02:09.291 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:09.289+0000 7fee8b96d0c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-08-21T15:02:09.291 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:09.289+0000 7fee8b96d0c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-08-21T15:02:09.291 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:09.289+0000 7fee8b96d0c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-08-21T15:02:09.292 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:09.289+0000 7fee8b96d0c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-08-21T15:02:09.292 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:09.289+0000 7fee8b96d0c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-08-21T15:02:12.138 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-08-21T15:02:12.167 INFO:tasks.ceph:Reading keys from all nodes... 2021-08-21T15:02:12.167 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:12.168 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-08-21T15:02:12.233 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:12.233 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-08-21T15:02:12.299 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:12.300 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-08-21T15:02:12.365 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:12.366 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-08-21T15:02:12.429 INFO:tasks.ceph:Adding keys to all mons... 2021-08-21T15:02:12.430 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2021-08-21T15:02:12.492 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2021-08-21T15:02:12.493 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBpFSFhfVbDEBAA3lxJ6qJiUw2hDCX0Dfw8ZQ== 2021-08-21T15:02:12.493 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2021-08-21T15:02:12.493 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBrFSFhhTL/EhAAt7ad4DOt6/bDTplRrV7k0Q== 2021-08-21T15:02:12.494 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2021-08-21T15:02:12.494 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBuFSFhCKeMEBAA3kUypaLPkTr2TOMmDl/qNQ== 2021-08-21T15:02:12.494 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2021-08-21T15:02:12.494 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBxFSFhRPVTERAA4uTfppkmylJ6i2mJtuZHpg== 2021-08-21T15:02:12.495 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-08-21T15:02:12.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-21T15:02:12.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-21T15:02:12.712 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-08-21T15:02:12.758 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-08-21T15:02:12.759 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-08-21T15:02:12.782 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-08-21T15:02:12.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-08-21T15:02:12.903 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-08-21T15:02:12.966 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-08-21T15:02:13.057 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-08-21T15:02:13.083 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-08-21T15:02:13.147 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-08-21T15:02:13.236 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-08-21T15:02:13.260 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-08-21T15:02:13.316 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-08-21T15:02:13.317 INFO:tasks.ceph.mon.a:Restarting daemon 2021-08-21T15:02:13.318 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-08-21T15:02:13.358 INFO:tasks.ceph.mon.a:Started 2021-08-21T15:02:13.359 INFO:tasks.ceph.mon.b:Restarting daemon 2021-08-21T15:02:13.359 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-08-21T15:02:13.361 INFO:tasks.ceph.mon.b:Started 2021-08-21T15:02:13.362 INFO:tasks.ceph.mon.c:Restarting daemon 2021-08-21T15:02:13.362 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-08-21T15:02:13.365 INFO:tasks.ceph.mon.c:Started 2021-08-21T15:02:13.366 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph config set mgr mgr_pool false --force 2021-08-21T15:02:13.793 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-08-21T15:02:13.794 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-08-21T15:02:13.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-08-21T15:02:13.798 INFO:tasks.ceph.mgr.x:Started 2021-08-21T15:02:13.798 INFO:tasks.ceph:Setting crush tunables to default 2021-08-21T15:02:13.799 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd crush tunables default 2021-08-21T15:02:13.997 INFO:teuthology.orchestra.run.smithi173.stderr:adjusted tunables profile to default 2021-08-21T15:02:14.007 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-08-21T15:02:14.009 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:14.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-08-21T15:02:14.032 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:14.033 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-08-21T15:02:14.097 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2021-08-21T15:02:14.097 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-08-21T15:02:14.162 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new c451cd41-e092-4d5b-8814-3fed7d05d1b1 0 2021-08-21T15:02:14.406 INFO:teuthology.orchestra.run.smithi173.stdout:0 2021-08-21T15:02:14.418 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 3be64b81-b923-4725-a4aa-e3881c179bc9 1 2021-08-21T15:02:14.620 INFO:teuthology.orchestra.run.smithi173.stdout:1 2021-08-21T15:02:14.636 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 2f78db3f-b431-434d-80ac-2de5ec7ac4f8 2 2021-08-21T15:02:14.847 INFO:teuthology.orchestra.run.smithi173.stdout:2 2021-08-21T15:02:14.859 INFO:tasks.ceph.osd.0:Restarting daemon 2021-08-21T15:02:14.860 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-08-21T15:02:14.863 INFO:tasks.ceph.osd.0:Started 2021-08-21T15:02:14.864 INFO:tasks.ceph.osd.1:Restarting daemon 2021-08-21T15:02:14.866 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-08-21T15:02:14.868 INFO:tasks.ceph.osd.1:Started 2021-08-21T15:02:14.870 INFO:tasks.ceph.osd.2:Restarting daemon 2021-08-21T15:02:14.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-08-21T15:02:14.874 INFO:tasks.ceph.osd.2:Started 2021-08-21T15:02:14.874 INFO:tasks.ceph:Waiting for OSDs to come up 2021-08-21T15:02:15.177 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-21T15:02:15.360 INFO:teuthology.misc.health.smithi173.stdout: 2021-08-21T15:02:15.360 INFO:teuthology.misc.health.smithi173.stdout:{"epoch":5,"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","created":"2021-08-21T15:02:13.689963+0000","modified":"2021-08-21T15:02:14.840770+0000","last_up_change":"0.000000","last_in_change":"2021-08-21T15:02:14.840770+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c451cd41-e092-4d5b-8814-3fed7d05d1b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3be64b81-b923-4725-a4aa-e3881c179bc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2f78db3f-b431-434d-80ac-2de5ec7ac4f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-21T15:02:15.371 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-08-21T15:02:15.463 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:02:15.462+0000 7f718a6ca0c0 -1 Falling back to public interface 2021-08-21T15:02:15.464 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:15.463+0000 7f3224f3f0c0 -1 Falling back to public interface 2021-08-21T15:02:15.465 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:15.463+0000 7f321f104700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2021-08-21T15:02:15.475 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:02:15.474+0000 7f850f52c0c0 -1 Falling back to public interface 2021-08-21T15:02:18.997 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:18.996+0000 7f3224f3f0c0 -1 osd.1 0 log_to_monitors {default=true} 2021-08-21T15:02:19.046 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:02:19.045+0000 7f850f52c0c0 -1 osd.2 0 log_to_monitors {default=true} 2021-08-21T15:02:19.050 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:02:19.049+0000 7f718a6ca0c0 -1 osd.0 0 log_to_monitors {default=true} 2021-08-21T15:02:20.451 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:02:20.450+0000 7f7181088700 -1 osd.0 0 waiting for initial osdmap 2021-08-21T15:02:20.454 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:02:20.454+0000 7f8505eea700 -1 osd.2 0 waiting for initial osdmap 2021-08-21T15:02:20.456 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:20.456+0000 7f321b8fd700 -1 osd.1 0 waiting for initial osdmap 2021-08-21T15:02:20.459 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:02:20.460+0000 7f84fe87d700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-21T15:02:20.462 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:02:20.462+0000 7f7179a1b700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-21T15:02:20.462 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:20.462+0000 7f3214290700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-21T15:02:21.673 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-08-21T15:02:21.957 INFO:teuthology.misc.health.smithi173.stdout: 2021-08-21T15:02:21.957 INFO:teuthology.misc.health.smithi173.stdout:{"epoch":8,"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","created":"2021-08-21T15:02:13.689963+0000","modified":"2021-08-21T15:02:21.449976+0000","last_up_change":"2021-08-21T15:02:21.449976+0000","last_in_change":"2021-08-21T15:02:14.840770+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c451cd41-e092-4d5b-8814-3fed7d05d1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":31933},{"type":"v1","addr":"172.21.15.173:6801","nonce":31933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":31933},{"type":"v1","addr":"172.21.15.173:6803","nonce":31933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":31933},{"type":"v1","addr":"172.21.15.173:6809","nonce":31933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":31933},{"type":"v1","addr":"172.21.15.173:6805","nonce":31933}]},"public_addr":"172.21.15.173:6801/31933","cluster_addr":"172.21.15.173:6803/31933","heartbeat_back_addr":"172.21.15.173:6809/31933","heartbeat_front_addr":"172.21.15.173:6805/31933","state":["exists","up"]},{"osd":1,"uuid":"3be64b81-b923-4725-a4aa-e3881c179bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":31934},{"type":"v1","addr":"172.21.15.173:6808","nonce":31934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":31934},{"type":"v1","addr":"172.21.15.173:6811","nonce":31934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":31934},{"type":"v1","addr":"172.21.15.173:6815","nonce":31934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":31934},{"type":"v1","addr":"172.21.15.173:6813","nonce":31934}]},"public_addr":"172.21.15.173:6808/31934","cluster_addr":"172.21.15.173:6811/31934","heartbeat_back_addr":"172.21.15.173:6815/31934","heartbeat_front_addr":"172.21.15.173:6813/31934","state":["exists","up"]},{"osd":2,"uuid":"2f78db3f-b431-434d-80ac-2de5ec7ac4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":31935},{"type":"v1","addr":"172.21.15.173:6817","nonce":31935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":31935},{"type":"v1","addr":"172.21.15.173:6819","nonce":31935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":31935},{"type":"v1","addr":"172.21.15.173:6823","nonce":31935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":31935},{"type":"v1","addr":"172.21.15.173:6821","nonce":31935}]},"public_addr":"172.21.15.173:6817/31935","cluster_addr":"172.21.15.173:6819/31935","heartbeat_back_addr":"172.21.15.173:6823/31935","heartbeat_front_addr":"172.21.15.173:6821/31935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-21T15:02:21.967 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-08-21T15:02:21.968 INFO:tasks.ceph:Creating RBD pool 2021-08-21T15:02:21.968 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd pool create rbd 8 2021-08-21T15:02:22.474 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'rbd' created 2021-08-21T15:02:22.597 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-08-21T15:02:23.475 INFO:teuthology.orchestra.run.smithi173.stderr:enabled application 'rbd' on pool 'rbd' 2021-08-21T15:02:23.488 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-08-21T15:02:23.490 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-08-21T15:02:23.491 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-08-21T15:02:23.773 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:23.773 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":10,"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","created":"2021-08-21T15:02:13.689963+0000","modified":"2021-08-21T15:02:23.465372+0000","last_up_change":"2021-08-21T15:02:21.449976+0000","last_in_change":"2021-08-21T15:02:14.840770+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-08-21T15:02:22.263582+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c451cd41-e092-4d5b-8814-3fed7d05d1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":31933},{"type":"v1","addr":"172.21.15.173:6801","nonce":31933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":31933},{"type":"v1","addr":"172.21.15.173:6803","nonce":31933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":31933},{"type":"v1","addr":"172.21.15.173:6809","nonce":31933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":31933},{"type":"v1","addr":"172.21.15.173:6805","nonce":31933}]},"public_addr":"172.21.15.173:6801/31933","cluster_addr":"172.21.15.173:6803/31933","heartbeat_back_addr":"172.21.15.173:6809/31933","heartbeat_front_addr":"172.21.15.173:6805/31933","state":["exists","up"]},{"osd":1,"uuid":"3be64b81-b923-4725-a4aa-e3881c179bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":31934},{"type":"v1","addr":"172.21.15.173:6808","nonce":31934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":31934},{"type":"v1","addr":"172.21.15.173:6811","nonce":31934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":31934},{"type":"v1","addr":"172.21.15.173:6815","nonce":31934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":31934},{"type":"v1","addr":"172.21.15.173:6813","nonce":31934}]},"public_addr":"172.21.15.173:6808/31934","cluster_addr":"172.21.15.173:6811/31934","heartbeat_back_addr":"172.21.15.173:6815/31934","heartbeat_front_addr":"172.21.15.173:6813/31934","state":["exists","up"]},{"osd":2,"uuid":"2f78db3f-b431-434d-80ac-2de5ec7ac4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":31935},{"type":"v1","addr":"172.21.15.173:6817","nonce":31935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":31935},{"type":"v1","addr":"172.21.15.173:6819","nonce":31935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":31935},{"type":"v1","addr":"172.21.15.173:6823","nonce":31935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":31935},{"type":"v1","addr":"172.21.15.173:6821","nonce":31935}]},"public_addr":"172.21.15.173:6817/31935","cluster_addr":"172.21.15.173:6819/31935","heartbeat_back_addr":"172.21.15.173:6823/31935","heartbeat_front_addr":"172.21.15.173:6821/31935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.062937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.042128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.049602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-21T15:02:23.788 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-08-21T15:02:22.263582+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-08-21T15:02:23.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-08-21T15:02:24.070 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 8 2021-08-21T15:02:24.083 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-08-21T15:02:24.083 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-08-21T15:02:24.084 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-08-21T15:02:24.405 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:24.418 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":4,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":31651},{"type":"v1","addr":"172.21.15.173:6825","nonce":31651}]},"active_addr":"172.21.15.173:6825/31651","active_change":"2021-08-21T15:02:18.311400+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-up","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm `scale-up` means that it starts out with minmum pgs and scales up when there is pressure, `scale-down` means starts out with full pgs and scales down when there is pressure ","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":3094429288}]},{"addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":844850988}]},{"addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":2706760332}]}]}} 2021-08-21T15:02:24.420 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-08-21T15:02:24.420 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-08-21T15:02:24.421 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-08-21T15:02:24.702 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:24.703 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":11,"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","created":"2021-08-21T15:02:13.689963+0000","modified":"2021-08-21T15:02:24.466822+0000","last_up_change":"2021-08-21T15:02:21.449976+0000","last_in_change":"2021-08-21T15:02:14.840770+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-08-21T15:02:22.263582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c451cd41-e092-4d5b-8814-3fed7d05d1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":31933},{"type":"v1","addr":"172.21.15.173:6801","nonce":31933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":31933},{"type":"v1","addr":"172.21.15.173:6803","nonce":31933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":31933},{"type":"v1","addr":"172.21.15.173:6809","nonce":31933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":31933},{"type":"v1","addr":"172.21.15.173:6805","nonce":31933}]},"public_addr":"172.21.15.173:6801/31933","cluster_addr":"172.21.15.173:6803/31933","heartbeat_back_addr":"172.21.15.173:6809/31933","heartbeat_front_addr":"172.21.15.173:6805/31933","state":["exists","up"]},{"osd":1,"uuid":"3be64b81-b923-4725-a4aa-e3881c179bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":31934},{"type":"v1","addr":"172.21.15.173:6808","nonce":31934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":31934},{"type":"v1","addr":"172.21.15.173:6811","nonce":31934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":31934},{"type":"v1","addr":"172.21.15.173:6815","nonce":31934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":31934},{"type":"v1","addr":"172.21.15.173:6813","nonce":31934}]},"public_addr":"172.21.15.173:6808/31934","cluster_addr":"172.21.15.173:6811/31934","heartbeat_back_addr":"172.21.15.173:6815/31934","heartbeat_front_addr":"172.21.15.173:6813/31934","state":["exists","up"]},{"osd":2,"uuid":"2f78db3f-b431-434d-80ac-2de5ec7ac4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":31935},{"type":"v1","addr":"172.21.15.173:6817","nonce":31935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":31935},{"type":"v1","addr":"172.21.15.173:6819","nonce":31935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":31935},{"type":"v1","addr":"172.21.15.173:6823","nonce":31935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":31935},{"type":"v1","addr":"172.21.15.173:6821","nonce":31935}]},"public_addr":"172.21.15.173:6817/31935","cluster_addr":"172.21.15.173:6819/31935","heartbeat_back_addr":"172.21.15.173:6823/31935","heartbeat_front_addr":"172.21.15.173:6821/31935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.062937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.042128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.049602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-21T15:02:24.715 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-08-21T15:02:24.716 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-08-21T15:02:24.995 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:24.995 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":11,"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","created":"2021-08-21T15:02:13.689963+0000","modified":"2021-08-21T15:02:24.466822+0000","last_up_change":"2021-08-21T15:02:21.449976+0000","last_in_change":"2021-08-21T15:02:14.840770+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-08-21T15:02:22.263582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c451cd41-e092-4d5b-8814-3fed7d05d1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":31933},{"type":"v1","addr":"172.21.15.173:6801","nonce":31933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":31933},{"type":"v1","addr":"172.21.15.173:6803","nonce":31933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":31933},{"type":"v1","addr":"172.21.15.173:6809","nonce":31933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":31933},{"type":"v1","addr":"172.21.15.173:6805","nonce":31933}]},"public_addr":"172.21.15.173:6801/31933","cluster_addr":"172.21.15.173:6803/31933","heartbeat_back_addr":"172.21.15.173:6809/31933","heartbeat_front_addr":"172.21.15.173:6805/31933","state":["exists","up"]},{"osd":1,"uuid":"3be64b81-b923-4725-a4aa-e3881c179bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":31934},{"type":"v1","addr":"172.21.15.173:6808","nonce":31934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":31934},{"type":"v1","addr":"172.21.15.173:6811","nonce":31934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":31934},{"type":"v1","addr":"172.21.15.173:6815","nonce":31934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":31934},{"type":"v1","addr":"172.21.15.173:6813","nonce":31934}]},"public_addr":"172.21.15.173:6808/31934","cluster_addr":"172.21.15.173:6811/31934","heartbeat_back_addr":"172.21.15.173:6815/31934","heartbeat_front_addr":"172.21.15.173:6813/31934","state":["exists","up"]},{"osd":2,"uuid":"2f78db3f-b431-434d-80ac-2de5ec7ac4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":31935},{"type":"v1","addr":"172.21.15.173:6817","nonce":31935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":31935},{"type":"v1","addr":"172.21.15.173:6819","nonce":31935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":31935},{"type":"v1","addr":"172.21.15.173:6823","nonce":31935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":31935},{"type":"v1","addr":"172.21.15.173:6821","nonce":31935}]},"public_addr":"172.21.15.173:6817/31935","cluster_addr":"172.21.15.173:6819/31935","heartbeat_back_addr":"172.21.15.173:6823/31935","heartbeat_front_addr":"172.21.15.173:6821/31935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.062937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.042128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.049602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-21T15:02:25.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-08-21T15:02:25.163 INFO:teuthology.orchestra.run.smithi173.stdout:34359738370 2021-08-21T15:02:25.164 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-08-21T15:02:25.307 INFO:teuthology.orchestra.run.smithi173.stdout:34359738372 2021-08-21T15:02:25.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-08-21T15:02:25.451 INFO:teuthology.orchestra.run.smithi173.stdout:34359738372 2021-08-21T15:02:25.453 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-08-21T15:02:25.733 INFO:teuthology.orchestra.run.smithi173.stdout:34359738369 2021-08-21T15:02:25.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738369 for osd.0 2021-08-21T15:02:26.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-08-21T15:02:27.040 INFO:teuthology.orchestra.run.smithi173.stdout:34359738370 2021-08-21T15:02:27.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.0 2021-08-21T15:02:27.055 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-08-21T15:02:27.334 INFO:teuthology.orchestra.run.smithi173.stdout:34359738372 2021-08-21T15:02:27.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.1 2021-08-21T15:02:27.347 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-08-21T15:02:27.629 INFO:teuthology.orchestra.run.smithi173.stdout:34359738372 2021-08-21T15:02:27.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.2 2021-08-21T15:02:27.642 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-08-21T15:02:27.643 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:02:27.918 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:27.919 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:02:27.931 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2021-08-21T15:02:26.319541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":14904,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":283100616,"statfs":{"total":289910292480,"available":289895030784,"internally_reserved":0,"allocated":294912,"data_stored":72018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476268+0000","last_change":"2021-08-21T15:02:23.473456+0000","last_active":"2021-08-21T15:02:23.476268+0000","last_peered":"2021-08-21T15:02:23.476268+0000","last_clean":"2021-08-21T15:02:23.476268+0000","last_became_active":"2021-08-21T15:02:23.473193+0000","last_became_peered":"2021-08-21T15:02:23.473193+0000","last_unstale":"2021-08-21T15:02:23.476268+0000","last_undegraded":"2021-08-21T15:02:23.476268+0000","last_fullsized":"2021-08-21T15:02:23.476268+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476469+0000","last_change":"2021-08-21T15:02:23.474725+0000","last_active":"2021-08-21T15:02:23.476469+0000","last_peered":"2021-08-21T15:02:23.476469+0000","last_clean":"2021-08-21T15:02:23.476469+0000","last_became_active":"2021-08-21T15:02:23.474114+0000","last_became_peered":"2021-08-21T15:02:23.474114+0000","last_unstale":"2021-08-21T15:02:23.476469+0000","last_undegraded":"2021-08-21T15:02:23.476469+0000","last_fullsized":"2021-08-21T15:02:23.476469+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.475449+0000","last_change":"2021-08-21T15:02:23.474326+0000","last_active":"2021-08-21T15:02:23.475449+0000","last_peered":"2021-08-21T15:02:23.475449+0000","last_clean":"2021-08-21T15:02:23.475449+0000","last_became_active":"2021-08-21T15:02:23.474045+0000","last_became_peered":"2021-08-21T15:02:23.474045+0000","last_unstale":"2021-08-21T15:02:23.475449+0000","last_undegraded":"2021-08-21T15:02:23.475449+0000","last_fullsized":"2021-08-21T15:02:23.475449+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476494+0000","last_change":"2021-08-21T15:02:23.474095+0000","last_active":"2021-08-21T15:02:23.476494+0000","last_peered":"2021-08-21T15:02:23.476494+0000","last_clean":"2021-08-21T15:02:23.476494+0000","last_became_active":"2021-08-21T15:02:23.473817+0000","last_became_peered":"2021-08-21T15:02:23.473817+0000","last_unstale":"2021-08-21T15:02:23.476494+0000","last_undegraded":"2021-08-21T15:02:23.476494+0000","last_fullsized":"2021-08-21T15:02:23.476494+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.477901+0000","last_change":"2021-08-21T15:02:23.477337+0000","last_active":"2021-08-21T15:02:23.477901+0000","last_peered":"2021-08-21T15:02:23.477901+0000","last_clean":"2021-08-21T15:02:23.477901+0000","last_became_active":"2021-08-21T15:02:23.477058+0000","last_became_peered":"2021-08-21T15:02:23.477058+0000","last_unstale":"2021-08-21T15:02:23.477901+0000","last_undegraded":"2021-08-21T15:02:23.477901+0000","last_fullsized":"2021-08-21T15:02:23.477901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476641+0000","last_change":"2021-08-21T15:02:23.473989+0000","last_active":"2021-08-21T15:02:23.476641+0000","last_peered":"2021-08-21T15:02:23.476641+0000","last_clean":"2021-08-21T15:02:23.476641+0000","last_became_active":"2021-08-21T15:02:23.473706+0000","last_became_peered":"2021-08-21T15:02:23.473706+0000","last_unstale":"2021-08-21T15:02:23.476641+0000","last_undegraded":"2021-08-21T15:02:23.476641+0000","last_fullsized":"2021-08-21T15:02:23.476641+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476463+0000","last_change":"2021-08-21T15:02:23.474572+0000","last_active":"2021-08-21T15:02:23.476463+0000","last_peered":"2021-08-21T15:02:23.476463+0000","last_clean":"2021-08-21T15:02:23.476463+0000","last_became_active":"2021-08-21T15:02:23.474262+0000","last_became_peered":"2021-08-21T15:02:23.474262+0000","last_unstale":"2021-08-21T15:02:23.476463+0000","last_undegraded":"2021-08-21T15:02:23.476463+0000","last_fullsized":"2021-08-21T15:02:23.476463+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.475426+0000","last_change":"2021-08-21T15:02:23.474197+0000","last_active":"2021-08-21T15:02:23.475426+0000","last_peered":"2021-08-21T15:02:23.475426+0000","last_clean":"2021-08-21T15:02:23.475426+0000","last_became_active":"2021-08-21T15:02:23.473962+0000","last_became_peered":"2021-08-21T15:02:23.473962+0000","last_unstale":"2021-08-21T15:02:23.475426+0000","last_undegraded":"2021-08-21T15:02:23.475426+0000","last_fullsized":"2021-08-21T15:02:23.475426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.192}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:02:27.932 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:02:28.206 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:28.207 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:02:28.218 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2021-08-21T15:02:26.319541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":14904,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":283100616,"statfs":{"total":289910292480,"available":289895030784,"internally_reserved":0,"allocated":294912,"data_stored":72018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476268+0000","last_change":"2021-08-21T15:02:23.473456+0000","last_active":"2021-08-21T15:02:23.476268+0000","last_peered":"2021-08-21T15:02:23.476268+0000","last_clean":"2021-08-21T15:02:23.476268+0000","last_became_active":"2021-08-21T15:02:23.473193+0000","last_became_peered":"2021-08-21T15:02:23.473193+0000","last_unstale":"2021-08-21T15:02:23.476268+0000","last_undegraded":"2021-08-21T15:02:23.476268+0000","last_fullsized":"2021-08-21T15:02:23.476268+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476469+0000","last_change":"2021-08-21T15:02:23.474725+0000","last_active":"2021-08-21T15:02:23.476469+0000","last_peered":"2021-08-21T15:02:23.476469+0000","last_clean":"2021-08-21T15:02:23.476469+0000","last_became_active":"2021-08-21T15:02:23.474114+0000","last_became_peered":"2021-08-21T15:02:23.474114+0000","last_unstale":"2021-08-21T15:02:23.476469+0000","last_undegraded":"2021-08-21T15:02:23.476469+0000","last_fullsized":"2021-08-21T15:02:23.476469+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.475449+0000","last_change":"2021-08-21T15:02:23.474326+0000","last_active":"2021-08-21T15:02:23.475449+0000","last_peered":"2021-08-21T15:02:23.475449+0000","last_clean":"2021-08-21T15:02:23.475449+0000","last_became_active":"2021-08-21T15:02:23.474045+0000","last_became_peered":"2021-08-21T15:02:23.474045+0000","last_unstale":"2021-08-21T15:02:23.475449+0000","last_undegraded":"2021-08-21T15:02:23.475449+0000","last_fullsized":"2021-08-21T15:02:23.475449+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476494+0000","last_change":"2021-08-21T15:02:23.474095+0000","last_active":"2021-08-21T15:02:23.476494+0000","last_peered":"2021-08-21T15:02:23.476494+0000","last_clean":"2021-08-21T15:02:23.476494+0000","last_became_active":"2021-08-21T15:02:23.473817+0000","last_became_peered":"2021-08-21T15:02:23.473817+0000","last_unstale":"2021-08-21T15:02:23.476494+0000","last_undegraded":"2021-08-21T15:02:23.476494+0000","last_fullsized":"2021-08-21T15:02:23.476494+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.477901+0000","last_change":"2021-08-21T15:02:23.477337+0000","last_active":"2021-08-21T15:02:23.477901+0000","last_peered":"2021-08-21T15:02:23.477901+0000","last_clean":"2021-08-21T15:02:23.477901+0000","last_became_active":"2021-08-21T15:02:23.477058+0000","last_became_peered":"2021-08-21T15:02:23.477058+0000","last_unstale":"2021-08-21T15:02:23.477901+0000","last_undegraded":"2021-08-21T15:02:23.477901+0000","last_fullsized":"2021-08-21T15:02:23.477901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476641+0000","last_change":"2021-08-21T15:02:23.473989+0000","last_active":"2021-08-21T15:02:23.476641+0000","last_peered":"2021-08-21T15:02:23.476641+0000","last_clean":"2021-08-21T15:02:23.476641+0000","last_became_active":"2021-08-21T15:02:23.473706+0000","last_became_peered":"2021-08-21T15:02:23.473706+0000","last_unstale":"2021-08-21T15:02:23.476641+0000","last_undegraded":"2021-08-21T15:02:23.476641+0000","last_fullsized":"2021-08-21T15:02:23.476641+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476463+0000","last_change":"2021-08-21T15:02:23.474572+0000","last_active":"2021-08-21T15:02:23.476463+0000","last_peered":"2021-08-21T15:02:23.476463+0000","last_clean":"2021-08-21T15:02:23.476463+0000","last_became_active":"2021-08-21T15:02:23.474262+0000","last_became_peered":"2021-08-21T15:02:23.474262+0000","last_unstale":"2021-08-21T15:02:23.476463+0000","last_undegraded":"2021-08-21T15:02:23.476463+0000","last_fullsized":"2021-08-21T15:02:23.476463+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.475426+0000","last_change":"2021-08-21T15:02:23.474197+0000","last_active":"2021-08-21T15:02:23.475426+0000","last_peered":"2021-08-21T15:02:23.475426+0000","last_clean":"2021-08-21T15:02:23.475426+0000","last_became_active":"2021-08-21T15:02:23.473962+0000","last_became_peered":"2021-08-21T15:02:23.473962+0000","last_unstale":"2021-08-21T15:02:23.475426+0000","last_undegraded":"2021-08-21T15:02:23.475426+0000","last_fullsized":"2021-08-21T15:02:23.475426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.192}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:02:28.219 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-08-21T15:02:28.219 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-08-21T15:02:28.220 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-08-21T15:02:28.220 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-08-21T15:02:28.561 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:28.561 INFO:teuthology.orchestra.run.smithi173.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-08-21T15:02:28.575 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-08-21T15:02:28.576 INFO:teuthology.run_tasks:Running task osd_recovery... 2021-08-21T15:02:28.598 INFO:tasks.osd_recovery:num_osds is 3 2021-08-21T15:02:28.599 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-08-21T15:02:28.881 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:28.881 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":11,"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","created":"2021-08-21T15:02:13.689963+0000","modified":"2021-08-21T15:02:24.466822+0000","last_up_change":"2021-08-21T15:02:21.449976+0000","last_in_change":"2021-08-21T15:02:14.840770+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-08-21T15:02:22.263582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c451cd41-e092-4d5b-8814-3fed7d05d1b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":31933},{"type":"v1","addr":"172.21.15.173:6801","nonce":31933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":31933},{"type":"v1","addr":"172.21.15.173:6803","nonce":31933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":31933},{"type":"v1","addr":"172.21.15.173:6809","nonce":31933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":31933},{"type":"v1","addr":"172.21.15.173:6805","nonce":31933}]},"public_addr":"172.21.15.173:6801/31933","cluster_addr":"172.21.15.173:6803/31933","heartbeat_back_addr":"172.21.15.173:6809/31933","heartbeat_front_addr":"172.21.15.173:6805/31933","state":["exists","up"]},{"osd":1,"uuid":"3be64b81-b923-4725-a4aa-e3881c179bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":31934},{"type":"v1","addr":"172.21.15.173:6808","nonce":31934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":31934},{"type":"v1","addr":"172.21.15.173:6811","nonce":31934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":31934},{"type":"v1","addr":"172.21.15.173:6815","nonce":31934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":31934},{"type":"v1","addr":"172.21.15.173:6813","nonce":31934}]},"public_addr":"172.21.15.173:6808/31934","cluster_addr":"172.21.15.173:6811/31934","heartbeat_back_addr":"172.21.15.173:6815/31934","heartbeat_front_addr":"172.21.15.173:6813/31934","state":["exists","up"]},{"osd":2,"uuid":"2f78db3f-b431-434d-80ac-2de5ec7ac4f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":31935},{"type":"v1","addr":"172.21.15.173:6817","nonce":31935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":31935},{"type":"v1","addr":"172.21.15.173:6819","nonce":31935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":31935},{"type":"v1","addr":"172.21.15.173:6823","nonce":31935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":31935},{"type":"v1","addr":"172.21.15.173:6821","nonce":31935}]},"public_addr":"172.21.15.173:6817/31935","cluster_addr":"172.21.15.173:6819/31935","heartbeat_back_addr":"172.21.15.173:6823/31935","heartbeat_front_addr":"172.21.15.173:6821/31935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.062937+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.042128+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-08-21T15:02:20.049602+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-08-21T15:02:28.894 INFO:tasks.osd_recovery.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-08-21T15:02:22.263582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-08-21T15:02:28.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-08-21T15:02:29.176 INFO:teuthology.orchestra.run.smithi173.stdout:pg_num: 8 2021-08-21T15:02:29.189 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2021-08-21T15:02:29.468 INFO:teuthology.orchestra.run.smithi173.stdout:epoch 11 2021-08-21T15:02:29.468 INFO:teuthology.orchestra.run.smithi173.stdout:fsid 90c992ca-066c-4cb6-b72f-9d34f4a3b9cc 2021-08-21T15:02:29.469 INFO:teuthology.orchestra.run.smithi173.stdout:created 2021-08-21T15:02:13.689963+0000 2021-08-21T15:02:29.469 INFO:teuthology.orchestra.run.smithi173.stdout:modified 2021-08-21T15:02:24.466822+0000 2021-08-21T15:02:29.469 INFO:teuthology.orchestra.run.smithi173.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2021-08-21T15:02:29.469 INFO:teuthology.orchestra.run.smithi173.stdout:crush_version 4 2021-08-21T15:02:29.469 INFO:teuthology.orchestra.run.smithi173.stdout:full_ratio 0.95 2021-08-21T15:02:29.470 INFO:teuthology.orchestra.run.smithi173.stdout:backfillfull_ratio 0.9 2021-08-21T15:02:29.470 INFO:teuthology.orchestra.run.smithi173.stdout:nearfull_ratio 0.85 2021-08-21T15:02:29.470 INFO:teuthology.orchestra.run.smithi173.stdout:require_min_compat_client luminous 2021-08-21T15:02:29.470 INFO:teuthology.orchestra.run.smithi173.stdout:min_compat_client jewel 2021-08-21T15:02:29.471 INFO:teuthology.orchestra.run.smithi173.stdout:require_osd_release quincy 2021-08-21T15:02:29.471 INFO:teuthology.orchestra.run.smithi173.stdout:stretch_mode_enabled false 2021-08-21T15:02:29.471 INFO:teuthology.orchestra.run.smithi173.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd 2021-08-21T15:02:29.471 INFO:teuthology.orchestra.run.smithi173.stdout:max_osd 3 2021-08-21T15:02:29.471 INFO:teuthology.orchestra.run.smithi173.stdout:osd.0 up in weight 1 up_from 8 up_thru 9 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] [v2:172.21.15.173:6802/31933,v1:172.21.15.173:6803/31933] exists,up c451cd41-e092-4d5b-8814-3fed7d05d1b1 2021-08-21T15:02:29.472 INFO:teuthology.orchestra.run.smithi173.stdout:osd.1 up in weight 1 up_from 8 up_thru 9 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] [v2:172.21.15.173:6810/31934,v1:172.21.15.173:6811/31934] exists,up 3be64b81-b923-4725-a4aa-e3881c179bc9 2021-08-21T15:02:29.472 INFO:teuthology.orchestra.run.smithi173.stdout:osd.2 up in weight 1 up_from 8 up_thru 9 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] [v2:172.21.15.173:6818/31935,v1:172.21.15.173:6819/31935] exists,up 2f78db3f-b431-434d-80ac-2de5ec7ac4f8 2021-08-21T15:02:29.481 INFO:tasks.osd_recovery.ceph_manager:['osd.0 up in weight 1 up_from 8 up_thru 9 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] [v2:172.21.15.173:6802/31933,v1:172.21.15.173:6803/31933] exists,up c451cd41-e092-4d5b-8814-3fed7d05d1b1', 'osd.1 up in weight 1 up_from 8 up_thru 9 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] [v2:172.21.15.173:6810/31934,v1:172.21.15.173:6811/31934] exists,up 3be64b81-b923-4725-a4aa-e3881c179bc9', 'osd.2 up in weight 1 up_from 8 up_thru 9 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] [v2:172.21.15.173:6818/31935,v1:172.21.15.173:6819/31935] exists,up 2f78db3f-b431-434d-80ac-2de5ec7ac4f8'] 2021-08-21T15:02:29.481 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-08-21T15:02:29.625 INFO:teuthology.orchestra.run.smithi173.stdout:34359738372 2021-08-21T15:02:29.626 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-08-21T15:02:29.770 INFO:teuthology.orchestra.run.smithi173.stdout:34359738374 2021-08-21T15:02:29.771 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-08-21T15:02:29.915 INFO:teuthology.orchestra.run.smithi173.stdout:34359738374 2021-08-21T15:02:29.916 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-08-21T15:02:30.194 INFO:teuthology.orchestra.run.smithi173.stdout:34359738371 2021-08-21T15:02:30.207 INFO:tasks.osd_recovery.ceph_manager:need seq 34359738372 got 34359738371 for osd.0 2021-08-21T15:02:31.208 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-08-21T15:02:31.508 INFO:teuthology.orchestra.run.smithi173.stdout:34359738372 2021-08-21T15:02:31.524 INFO:tasks.osd_recovery.ceph_manager:need seq 34359738372 got 34359738372 for osd.0 2021-08-21T15:02:31.524 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-08-21T15:02:31.807 INFO:teuthology.orchestra.run.smithi173.stdout:34359738374 2021-08-21T15:02:31.821 INFO:tasks.osd_recovery.ceph_manager:need seq 34359738374 got 34359738374 for osd.1 2021-08-21T15:02:31.822 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-08-21T15:02:32.102 INFO:teuthology.orchestra.run.smithi173.stdout:34359738374 2021-08-21T15:02:32.116 INFO:tasks.osd_recovery.ceph_manager:need seq 34359738374 got 34359738374 for osd.2 2021-08-21T15:02:32.116 INFO:tasks.osd_recovery.ceph_manager:waiting for clean 2021-08-21T15:02:32.117 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:02:32.391 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:32.393 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:02:32.407 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-08-21T15:02:32.320733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":14904,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":283100616,"statfs":{"total":289910292480,"available":289895030784,"internally_reserved":0,"allocated":294912,"data_stored":72018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476268+0000","last_change":"2021-08-21T15:02:23.473456+0000","last_active":"2021-08-21T15:02:23.476268+0000","last_peered":"2021-08-21T15:02:23.476268+0000","last_clean":"2021-08-21T15:02:23.476268+0000","last_became_active":"2021-08-21T15:02:23.473193+0000","last_became_peered":"2021-08-21T15:02:23.473193+0000","last_unstale":"2021-08-21T15:02:23.476268+0000","last_undegraded":"2021-08-21T15:02:23.476268+0000","last_fullsized":"2021-08-21T15:02:23.476268+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476469+0000","last_change":"2021-08-21T15:02:23.474725+0000","last_active":"2021-08-21T15:02:23.476469+0000","last_peered":"2021-08-21T15:02:23.476469+0000","last_clean":"2021-08-21T15:02:23.476469+0000","last_became_active":"2021-08-21T15:02:23.474114+0000","last_became_peered":"2021-08-21T15:02:23.474114+0000","last_unstale":"2021-08-21T15:02:23.476469+0000","last_undegraded":"2021-08-21T15:02:23.476469+0000","last_fullsized":"2021-08-21T15:02:23.476469+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.475449+0000","last_change":"2021-08-21T15:02:23.474326+0000","last_active":"2021-08-21T15:02:23.475449+0000","last_peered":"2021-08-21T15:02:23.475449+0000","last_clean":"2021-08-21T15:02:23.475449+0000","last_became_active":"2021-08-21T15:02:23.474045+0000","last_became_peered":"2021-08-21T15:02:23.474045+0000","last_unstale":"2021-08-21T15:02:23.475449+0000","last_undegraded":"2021-08-21T15:02:23.475449+0000","last_fullsized":"2021-08-21T15:02:23.475449+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476494+0000","last_change":"2021-08-21T15:02:23.474095+0000","last_active":"2021-08-21T15:02:23.476494+0000","last_peered":"2021-08-21T15:02:23.476494+0000","last_clean":"2021-08-21T15:02:23.476494+0000","last_became_active":"2021-08-21T15:02:23.473817+0000","last_became_peered":"2021-08-21T15:02:23.473817+0000","last_unstale":"2021-08-21T15:02:23.476494+0000","last_undegraded":"2021-08-21T15:02:23.476494+0000","last_fullsized":"2021-08-21T15:02:23.476494+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.477901+0000","last_change":"2021-08-21T15:02:23.477337+0000","last_active":"2021-08-21T15:02:23.477901+0000","last_peered":"2021-08-21T15:02:23.477901+0000","last_clean":"2021-08-21T15:02:23.477901+0000","last_became_active":"2021-08-21T15:02:23.477058+0000","last_became_peered":"2021-08-21T15:02:23.477058+0000","last_unstale":"2021-08-21T15:02:23.477901+0000","last_undegraded":"2021-08-21T15:02:23.477901+0000","last_fullsized":"2021-08-21T15:02:23.477901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476641+0000","last_change":"2021-08-21T15:02:23.473989+0000","last_active":"2021-08-21T15:02:23.476641+0000","last_peered":"2021-08-21T15:02:23.476641+0000","last_clean":"2021-08-21T15:02:23.476641+0000","last_became_active":"2021-08-21T15:02:23.473706+0000","last_became_peered":"2021-08-21T15:02:23.473706+0000","last_unstale":"2021-08-21T15:02:23.476641+0000","last_undegraded":"2021-08-21T15:02:23.476641+0000","last_fullsized":"2021-08-21T15:02:23.476641+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476463+0000","last_change":"2021-08-21T15:02:23.474572+0000","last_active":"2021-08-21T15:02:23.476463+0000","last_peered":"2021-08-21T15:02:23.476463+0000","last_clean":"2021-08-21T15:02:23.476463+0000","last_became_active":"2021-08-21T15:02:23.474262+0000","last_became_peered":"2021-08-21T15:02:23.474262+0000","last_unstale":"2021-08-21T15:02:23.476463+0000","last_undegraded":"2021-08-21T15:02:23.476463+0000","last_fullsized":"2021-08-21T15:02:23.476463+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.475426+0000","last_change":"2021-08-21T15:02:23.474197+0000","last_active":"2021-08-21T15:02:23.475426+0000","last_peered":"2021-08-21T15:02:23.475426+0000","last_clean":"2021-08-21T15:02:23.475426+0000","last_became_active":"2021-08-21T15:02:23.473962+0000","last_became_peered":"2021-08-21T15:02:23.473962+0000","last_unstale":"2021-08-21T15:02:23.475426+0000","last_undegraded":"2021-08-21T15:02:23.475426+0000","last_fullsized":"2021-08-21T15:02:23.475426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:02:32.409 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:02:32.686 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:02:32.689 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:02:32.699 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-08-21T15:02:32.320733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":14904,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":14592,"kb_avail":283100616,"statfs":{"total":289910292480,"available":289895030784,"internally_reserved":0,"allocated":294912,"data_stored":72018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14942208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476268+0000","last_change":"2021-08-21T15:02:23.473456+0000","last_active":"2021-08-21T15:02:23.476268+0000","last_peered":"2021-08-21T15:02:23.476268+0000","last_clean":"2021-08-21T15:02:23.476268+0000","last_became_active":"2021-08-21T15:02:23.473193+0000","last_became_peered":"2021-08-21T15:02:23.473193+0000","last_unstale":"2021-08-21T15:02:23.476268+0000","last_undegraded":"2021-08-21T15:02:23.476268+0000","last_fullsized":"2021-08-21T15:02:23.476268+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476469+0000","last_change":"2021-08-21T15:02:23.474725+0000","last_active":"2021-08-21T15:02:23.476469+0000","last_peered":"2021-08-21T15:02:23.476469+0000","last_clean":"2021-08-21T15:02:23.476469+0000","last_became_active":"2021-08-21T15:02:23.474114+0000","last_became_peered":"2021-08-21T15:02:23.474114+0000","last_unstale":"2021-08-21T15:02:23.476469+0000","last_undegraded":"2021-08-21T15:02:23.476469+0000","last_fullsized":"2021-08-21T15:02:23.476469+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.475449+0000","last_change":"2021-08-21T15:02:23.474326+0000","last_active":"2021-08-21T15:02:23.475449+0000","last_peered":"2021-08-21T15:02:23.475449+0000","last_clean":"2021-08-21T15:02:23.475449+0000","last_became_active":"2021-08-21T15:02:23.474045+0000","last_became_peered":"2021-08-21T15:02:23.474045+0000","last_unstale":"2021-08-21T15:02:23.475449+0000","last_undegraded":"2021-08-21T15:02:23.475449+0000","last_fullsized":"2021-08-21T15:02:23.475449+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476494+0000","last_change":"2021-08-21T15:02:23.474095+0000","last_active":"2021-08-21T15:02:23.476494+0000","last_peered":"2021-08-21T15:02:23.476494+0000","last_clean":"2021-08-21T15:02:23.476494+0000","last_became_active":"2021-08-21T15:02:23.473817+0000","last_became_peered":"2021-08-21T15:02:23.473817+0000","last_unstale":"2021-08-21T15:02:23.476494+0000","last_undegraded":"2021-08-21T15:02:23.476494+0000","last_fullsized":"2021-08-21T15:02:23.476494+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.477901+0000","last_change":"2021-08-21T15:02:23.477337+0000","last_active":"2021-08-21T15:02:23.477901+0000","last_peered":"2021-08-21T15:02:23.477901+0000","last_clean":"2021-08-21T15:02:23.477901+0000","last_became_active":"2021-08-21T15:02:23.477058+0000","last_became_peered":"2021-08-21T15:02:23.477058+0000","last_unstale":"2021-08-21T15:02:23.477901+0000","last_undegraded":"2021-08-21T15:02:23.477901+0000","last_fullsized":"2021-08-21T15:02:23.477901+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476641+0000","last_change":"2021-08-21T15:02:23.473989+0000","last_active":"2021-08-21T15:02:23.476641+0000","last_peered":"2021-08-21T15:02:23.476641+0000","last_clean":"2021-08-21T15:02:23.476641+0000","last_became_active":"2021-08-21T15:02:23.473706+0000","last_became_peered":"2021-08-21T15:02:23.473706+0000","last_unstale":"2021-08-21T15:02:23.476641+0000","last_undegraded":"2021-08-21T15:02:23.476641+0000","last_fullsized":"2021-08-21T15:02:23.476641+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.476463+0000","last_change":"2021-08-21T15:02:23.474572+0000","last_active":"2021-08-21T15:02:23.476463+0000","last_peered":"2021-08-21T15:02:23.476463+0000","last_clean":"2021-08-21T15:02:23.476463+0000","last_became_active":"2021-08-21T15:02:23.474262+0000","last_became_peered":"2021-08-21T15:02:23.474262+0000","last_unstale":"2021-08-21T15:02:23.476463+0000","last_undegraded":"2021-08-21T15:02:23.476463+0000","last_fullsized":"2021-08-21T15:02:23.476463+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-08-21T15:02:23.475426+0000","last_change":"2021-08-21T15:02:23.474197+0000","last_active":"2021-08-21T15:02:23.475426+0000","last_peered":"2021-08-21T15:02:23.475426+0000","last_clean":"2021-08-21T15:02:23.475426+0000","last_became_active":"2021-08-21T15:02:23.473962+0000","last_became_peered":"2021-08-21T15:02:23.473962+0000","last_unstale":"2021-08-21T15:02:23.475426+0000","last_undegraded":"2021-08-21T15:02:23.475426+0000","last_fullsized":"2021-08-21T15:02:23.475426+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4968,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366872,"statfs":{"total":96636764160,"available":96631676928,"internally_reserved":0,"allocated":98304,"data_stored":24006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:02:32.701 INFO:tasks.osd_recovery.ceph_manager:clean! 2021-08-21T15:02:32.701 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noin 2021-08-21T15:02:33.510 INFO:teuthology.orchestra.run.smithi173.stderr:noin is set 2021-08-21T15:02:33.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noout 2021-08-21T15:02:34.518 INFO:teuthology.orchestra.run.smithi173.stderr:noout is set 2021-08-21T15:02:34.531 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noup 2021-08-21T15:02:35.525 INFO:teuthology.orchestra.run.smithi173.stderr:noup is set 2021-08-21T15:02:35.538 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodown 2021-08-21T15:02:36.535 INFO:teuthology.orchestra.run.smithi173.stderr:nodown is set 2021-08-21T15:02:36.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noin 2021-08-21T15:02:37.535 INFO:teuthology.orchestra.run.smithi173.stderr:noin is unset 2021-08-21T15:02:37.548 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noout 2021-08-21T15:02:38.551 INFO:teuthology.orchestra.run.smithi173.stderr:noout is unset 2021-08-21T15:02:38.566 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noup 2021-08-21T15:02:39.554 INFO:teuthology.orchestra.run.smithi173.stderr:noup is unset 2021-08-21T15:02:39.567 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodown 2021-08-21T15:02:40.562 INFO:teuthology.orchestra.run.smithi173.stderr:nodown is unset 2021-08-21T15:02:40.575 INFO:tasks.osd_recovery:rados -p rbd bench 20 write -b 4096 --no-cleanup 2021-08-21T15:02:40.575 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rbd bench 20 write -b 4096 --no-cleanup 2021-08-21T15:02:40.619 INFO:teuthology.orchestra.run.smithi173.stdout:hints = 1 2021-08-21T15:02:40.619 INFO:teuthology.orchestra.run.smithi173.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 20 seconds or 0 objects 2021-08-21T15:02:40.620 INFO:teuthology.orchestra.run.smithi173.stdout:Object prefix: benchmark_data_smithi173_36165 2021-08-21T15:02:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-08-21T15:02:40.620 INFO:teuthology.orchestra.run.smithi173.stdout: 0 0 0 0 0 0 - 0 2021-08-21T15:02:40.653 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:40.653+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d46e0 msgr2=0x55af9b0d6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:40.660 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:40.660+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:41.623 INFO:teuthology.orchestra.run.smithi173.stdout: 1 16 2613 2597 10.144 10.1445 0.0100008 0.00613077 2021-08-21T15:02:41.959 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:41.958+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:41.970 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:41.970+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d46e0 msgr2=0x7f0798038ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-21T15:02:41.977 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:41.977+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:42.127 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:42.126+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d46e0 msgr2=0x7f0798039920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:42.619 INFO:teuthology.orchestra.run.smithi173.stdout: 2 16 4995 4979 9.72418 9.30469 0.00596106 0.0064145 2021-08-21T15:02:42.986 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:42.985+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:43.619 INFO:teuthology.orchestra.run.smithi173.stdout: 3 16 7234 7218 9.39791 8.74609 0.0067095 0.0066385 2021-08-21T15:02:43.739 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:43.737+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x55af9b0d80b0 msgr2=0x7f07980393e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:43.965 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:43.963+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d80b0 msgr2=0x7f07980393e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:44.342 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:44.341+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d80b0 msgr2=0x7f0798039340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:44.621 INFO:teuthology.orchestra.run.smithi173.stdout: 4 16 9281 9265 9.04729 7.99609 0.00637218 0.00689938 2021-08-21T15:02:45.174 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:45.172+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0dbc20 msgr2=0x7f079803b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:45.620 INFO:teuthology.orchestra.run.smithi173.stdout: 5 16 11196 11180 8.73237 7.48047 0.00556034 0.00715048 2021-08-21T15:02:46.620 INFO:teuthology.orchestra.run.smithi173.stdout: 6 16 13003 12987 8.45336 7.05859 0.00508593 0.00738264 2021-08-21T15:02:47.099 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:47.098+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x55af9b0d46e0 msgr2=0x7f0798039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-21T15:02:47.621 INFO:teuthology.orchestra.run.smithi173.stdout: 7 16 14696 14680 8.18985 6.61328 0.00994758 0.00762462 2021-08-21T15:02:48.422 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:48.420+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:48.621 INFO:teuthology.orchestra.run.smithi173.stdout: 8 16 16277 16261 7.93807 6.17578 0.00526573 0.00786663 2021-08-21T15:02:48.649 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:48.647+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:49.620 INFO:teuthology.orchestra.run.smithi173.stdout: 9 16 17826 17810 7.72835 6.05078 0.00894118 0.00807819 2021-08-21T15:02:50.622 INFO:teuthology.orchestra.run.smithi173.stdout: 10 16 19277 19261 7.52116 5.66797 0.0137841 0.00830255 2021-08-21T15:02:50.657 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:50.656+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:50.709 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:50.708+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0dbc20 msgr2=0x7f079803b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-21T15:02:50.768 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:50.767+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:51.302 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:51.300+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:51.622 INFO:teuthology.orchestra.run.smithi173.stdout: 11 16 20687 20671 7.33814 5.50781 0.0139458 0.0085093 2021-08-21T15:02:51.755 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:51.754+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x55af9b0d46e0 msgr2=0x7f0798039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:51.816 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:51.814+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0dbc20 msgr2=0x7f079803b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:52.524 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:52.522+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d46e0 msgr2=0x7f0798039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:52.624 INFO:teuthology.orchestra.run.smithi173.stdout: 12 15 22061 22046 7.17422 5.37109 0.00995222 0.00870467 2021-08-21T15:02:52.729 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:52.727+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d46e0 msgr2=0x7f0798039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:52.729 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:52.727+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d46e0 msgr2=0x7f0798039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:52.841 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:52.839+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:52.882 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:52.880+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x55af9b0d46e0 msgr2=0x7f0798039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:53.483 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:53.482+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0dbc20 msgr2=0x7f079803b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:53.622 INFO:teuthology.orchestra.run.smithi173.stdout: 13 16 23375 23359 7.0169 5.12891 0.0141085 0.00889969 2021-08-21T15:02:54.077 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:54.076+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:54.623 INFO:teuthology.orchestra.run.smithi173.stdout: 14 16 24649 24633 6.87104 4.97656 0.0106788 0.009089 2021-08-21T15:02:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:54.631+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d46e0 msgr2=0x7f0798039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-21T15:02:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:55.572+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0d46e0 msgr2=0x7f0798039880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-21T15:02:55.578 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell osd.1 injectargs --objectstore-blackhole=true 2021-08-21T15:02:55.631 INFO:teuthology.orchestra.run.smithi173.stdout: 15 16 25876 25860 6.73215 4.79297 0.0119743 0.00927602 2021-08-21T15:02:55.634 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:55.633+0000 7f07b6a5b700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6806/31934,v1:172.21.15.173:6808/31934] conn(0x55af9b0dbc20 msgr2=0x7f079803b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:55.816 INFO:teuthology.orchestra.run.smithi173.stdout:{} 2021-08-21T15:02:55.817 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.811+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.818 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.812+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.818 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.812+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.812+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.812+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.813+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.813+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.814+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.822 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.814+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.822 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.815+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.815+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.816+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.816+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.816+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.816+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.818+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.818+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.819+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.819+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.825 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.820+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.825 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.820+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.820+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.821+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.821+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.821+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.821+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.829 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.824+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.830 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.825+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.830 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.825+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.830 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.825+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.826+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.827+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.827+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.832 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.828+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.832 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.828+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:objectstore_blackhole = 'true' (not observed, change may require restart) 2021-08-21T15:02:55.834 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.830+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.835 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.831+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.835 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.831+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.835 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.831+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.836 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.831+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.836 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.832+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.836 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.832+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.836 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.832+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.837 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.834+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.837 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.834+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.838 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.834+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.839 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.837+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.839 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.837+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.839 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.838+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.840 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.838+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.840 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.838+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.841 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.838+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.859 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.844+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.859 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.844+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.860 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.844+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.860 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.844+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.860 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.844+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.860 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.845+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.861 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.845+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.861 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.846+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.861 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.846+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.861 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.846+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.862 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.846+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.862 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.846+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.862 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.847+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.862 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.847+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.863 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.847+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.863 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.847+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.863 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.848+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.863 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.848+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.863 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.848+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.864 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.848+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.864 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.849+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.864 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.849+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.864 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.849+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.849+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.849+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.851+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.851+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.851+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.866 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.852+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.866 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.853+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.866 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.853+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.867 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.853+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.867 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.854+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.868 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.854+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.868 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.854+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.868 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.855+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.868 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.855+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.868 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.856+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.869 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.857+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.870 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.857+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.870 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.857+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.870 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.857+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.870 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.858+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.870 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.858+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.874 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.858+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.874 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.859+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.875 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.859+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.875 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.859+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.860+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.860+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.860+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.860+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.860+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.861+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.862+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.863+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.863+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.878 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.864+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.878 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.865+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.878 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.865+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.878 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.866+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.879 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.866+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.879 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.867+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.879 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.868+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.880 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.868+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.880 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.868+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.880 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.869+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.880 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.869+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.881 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.869+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.881 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.870+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.881 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.870+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.881 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.870+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.881 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.871+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.883 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.871+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.883 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.871+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.883 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.871+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.897 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.872+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.897 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.872+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.898 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.872+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.898 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.873+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.898 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.873+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.898 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.873+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.899 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.873+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.899 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.873+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.899 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.874+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.899 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.874+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.900 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.875+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.900 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.875+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.900 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.876+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.900 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.876+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.901 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.876+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.901 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.876+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.901 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.879+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.901 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.879+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.901 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.879+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.902 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.880+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.902 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.881+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.902 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.881+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.902 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.881+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.903 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.881+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.903 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.881+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.903 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.882+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.903 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.882+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.903 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.882+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.904 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.883+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.904 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.883+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.904 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.883+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.904 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.884+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.905 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.884+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.905 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.884+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.905 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.885+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.905 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.885+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.905 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.887+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.906 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.887+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.906 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.887+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.906 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.888+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.906 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.888+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.907 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.889+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.907 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.889+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.907 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.890+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.908 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.890+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.908 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.892+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.908 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.892+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.908 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.893+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.909 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.893+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.909 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.893+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.909 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.893+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.909 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.893+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.909 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.894+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.910 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.894+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.910 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.894+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.910 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.894+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.910 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.895+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.911 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.895+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.911 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.895+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.915 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.897+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.915 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.897+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.915 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.898+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.915 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.898+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.916 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.899+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.916 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.899+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.916 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.901+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.916 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.901+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.917 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.901+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.917 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.901+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.917 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.901+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.917 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.902+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.918 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.902+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.918 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.903+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.918 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.903+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.919 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.903+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.919 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.904+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.919 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.905+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.920 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.905+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.920 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.905+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.920 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.905+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.920 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.905+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.920 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.905+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.921 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.906+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.921 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.906+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.921 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.906+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.921 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.906+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.907+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.907+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.907+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.907+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.907+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.909+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.910+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.910+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.910+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.924 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.910+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.924 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.910+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.924 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.911+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.924 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.911+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.924 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.911+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.911+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.912+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.913+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.913+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.928 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.914+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.929 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.914+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.929 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.914+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.929 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.916+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.929 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.917+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.930 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.917+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.930 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.918+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.930 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.918+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.930 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.918+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.930 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.920+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.931 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.920+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.931 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.921+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.931 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.921+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.931 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.922+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.932 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.923+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.932 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.923+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.932 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.924+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.932 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.924+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.932 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.924+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.933 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.924+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.933 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.925+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.933 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.925+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.934 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.926+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.934 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.926+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.935 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.929+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.935 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.929+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.936 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.929+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.936 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.929+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.936 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.930+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.936 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.931+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.936 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.931+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.937 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.931+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.937 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.931+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.937 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.933+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.937 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.933+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.940 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.935+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.940 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.935+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.940 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.935+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.940 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.936+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.941 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.936+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.941 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.936+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.941 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.937+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.941 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.937+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.942 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.937+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.942 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.937+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.944 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.937+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.945 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.939+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.945 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.940+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.940+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.940+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.941+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.941+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.943+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.947 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.943+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.947 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.943+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.947 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.943+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.948 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.945+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.948 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.945+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.948 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.946+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.950 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.947+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.950 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.947+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.951 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.947+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.951 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.948+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.951 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.948+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.970 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.951+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.973 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.952+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.973 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.952+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.973 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.953+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.973 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.953+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.974 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.953+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.974 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.954+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.974 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.954+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.974 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.954+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.975 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.954+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.975 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.954+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.975 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.955+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.975 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.955+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.976 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.955+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.976 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.955+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.976 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.955+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.976 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.957+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.977 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.958+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.977 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.958+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.977 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.959+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.977 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.959+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.977 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.959+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.978 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.959+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.978 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.959+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.978 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.959+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.978 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.960+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.979 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.960+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.979 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.960+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.979 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.960+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.979 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.961+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.979 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.961+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.980 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.961+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.980 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.961+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.980 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.961+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.980 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.964+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.981 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.964+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.981 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.964+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.981 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.964+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.981 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.964+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.981 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.965+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.982 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.965+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.982 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.965+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.983 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.966+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.983 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.967+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.983 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.967+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.988 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.969+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.988 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.969+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.988 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.969+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.988 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.969+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.989 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.969+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.989 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.970+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.989 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.970+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.990 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.970+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.990 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.971+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.990 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.971+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.990 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.973+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.991 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.973+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.991 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.973+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.991 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.973+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.991 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.973+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.992 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.974+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.992 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.974+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.992 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.974+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.992 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.975+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.993 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.975+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.993 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.976+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.993 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.977+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.993 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.977+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.993 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.977+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.994 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.977+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.994 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.978+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.994 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.978+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.994 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.978+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.995 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.979+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.995 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.981+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.999 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.981+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.999 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.981+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:55.999 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.981+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.981+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.982+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.982+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.982+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.001 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.982+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.001 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.982+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.006 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.983+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.006 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.983+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.006 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.984+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.007 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.985+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.007 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.985+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.007 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.985+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.007 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.985+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.008 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.985+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.008 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.986+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.011 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.987+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.016 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.988+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.016 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.988+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.017 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.988+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.017 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.989+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.017 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.989+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.017 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.989+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.018 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.990+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.018 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.990+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.018 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.990+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.018 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.991+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.019 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.991+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.019 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.993+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.019 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.993+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.020 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.994+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.020 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.995+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.020 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.996+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.020 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.996+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.020 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.996+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.021 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.996+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.021 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.997+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.021 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.997+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.021 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.998+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.022 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.998+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.022 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.998+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.022 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.998+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.023 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.999+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.023 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.999+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.023 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:55.999+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.023 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.000+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.024 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.000+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.024 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.000+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.024 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.000+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.024 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.001+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.025 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.001+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.025 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.001+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.025 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.001+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.026 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.003+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.026 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.003+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.027 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.003+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.027 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.003+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.027 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.004+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.028 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.004+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.028 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.005+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.028 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.005+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.028 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.005+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.029 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.006+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.029 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.006+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.030 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.006+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.030 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.007+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.031 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.007+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.041 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.008+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.042 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.008+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.042 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.008+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.042 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.008+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.043 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.008+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.043 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.009+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.043 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.010+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.044 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.010+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.044 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.010+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.051 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.010+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.052 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.011+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.052 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.011+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.053 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.012+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.053 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.012+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.053 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.012+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.053 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.013+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.054 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.013+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.054 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.013+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.055 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.014+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.055 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.015+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.055 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.015+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.055 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.015+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.056 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.015+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.056 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.016+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.056 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.016+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.057 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.016+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.057 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.016+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.057 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.016+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.057 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.017+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.058 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.017+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.058 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.019+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.058 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.019+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.058 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.020+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.059 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.021+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.059 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.022+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.059 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.022+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.059 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.022+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.059 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.022+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.060 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.022+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.060 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.024+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.060 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.024+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.060 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.025+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.061 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.025+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.061 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.025+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.061 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.025+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.061 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.025+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.061 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.025+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.062 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.026+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.062 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.027+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.062 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.027+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.062 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.027+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.063 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.027+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.063 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.027+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.063 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.028+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.063 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.029+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.064 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.030+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.064 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.030+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.065 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.030+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.065 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.030+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.065 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.030+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.065 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.031+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.065 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.032+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.066 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.032+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.066 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.034+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.067 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.034+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.067 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.034+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.067 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.034+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.067 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.034+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.068 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.035+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.068 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.036+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.068 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.037+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.068 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.037+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.068 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.037+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.069 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.038+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.069 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.038+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.040+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.040+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.040+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.041+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.075 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.041+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.075 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.041+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.075 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.041+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.075 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.042+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.076 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.042+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.076 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.042+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.076 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.042+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.076 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.043+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.076 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.043+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.077 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.043+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.077 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.044+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.077 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.044+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.079 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.044+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.079 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.044+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.080 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.045+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.080 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.045+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.080 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.045+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.083 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.046+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.083 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.047+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.084 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.048+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.084 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.048+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.096 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.050+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.097 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.050+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.097 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.051+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.097 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.051+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.097 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.051+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.098 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.052+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.098 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.052+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.098 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.052+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.099 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.053+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.099 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.053+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.100 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.053+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.100 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.053+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.100 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.054+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.101 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.054+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.101 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.054+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.102 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.054+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.102 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.055+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.103 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.055+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.103 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.055+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.103 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.056+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.104 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.056+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.104 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.056+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.105 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.057+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.105 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.057+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.105 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.057+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.106 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.057+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.106 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.057+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.106 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.058+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.107 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.058+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.107 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.058+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.108 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.059+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.108 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.060+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.108 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.060+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.108 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.061+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.062+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.062+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.064+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.064+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.110 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.064+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.110 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.064+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.111 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.064+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.112 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.065+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.112 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.065+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.112 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.066+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.112 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.067+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.113 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.067+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.113 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.068+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.113 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.069+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.069+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.069+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.069+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.069+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.070+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.070+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.070+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.070+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.071+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.116 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.071+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.116 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.072+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.116 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.072+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.116 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.072+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.117 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.072+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.117 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.073+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.117 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.074+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.117 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.074+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.117 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.074+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.118 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.075+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.118 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.075+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.118 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.075+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.118 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.076+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.119 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.076+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.119 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.076+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.119 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.077+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.119 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.077+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.077+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.077+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.079+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.079+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.079+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.081+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.082+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.082+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.083+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.122 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.084+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.122 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.084+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.122 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.084+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.124 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.085+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.125 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.085+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.125 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.086+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.125 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.086+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.126 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.086+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.126 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.088+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.126 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.088+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.127 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.088+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.127 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.090+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.127 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.091+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.127 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.091+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.128 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.091+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.128 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.092+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.128 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.092+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.128 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.092+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.128 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.092+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.129 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.092+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.129 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.093+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.129 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.093+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.137 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.095+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.138 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.097+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.139 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.097+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.139 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.097+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.139 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.097+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.140 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.098+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.140 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.098+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.140 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.098+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.140 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.098+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.140 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.099+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.141 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.099+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.141 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.099+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.141 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.100+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.141 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.100+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.142 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.101+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.142 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.102+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.142 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.103+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.142 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.103+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.142 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.103+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.143 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.104+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.143 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.104+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.143 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.104+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.143 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.105+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.105+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.105+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.105+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.106+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.107+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.145 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.107+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.145 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.107+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.145 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.107+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.145 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.108+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.108+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.109+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.110+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.110+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.112+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.147 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.112+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.147 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.112+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.147 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.112+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.147 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.113+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.113+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.114+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.114+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.114+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.115+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.149 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.116+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.149 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.116+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.149 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.117+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.149 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.117+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.150 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.117+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.150 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.117+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.150 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.118+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.150 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.118+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.151 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.118+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.151 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.119+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.151 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.119+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.151 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.119+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.152 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.119+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.152 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.119+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.152 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.120+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.152 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.121+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.152 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.121+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.153 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.121+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.153 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.122+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.153 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.123+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.153 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.123+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.124+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.124+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.126+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.126+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.126+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.126+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.127+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.127+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.127+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.156 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.127+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.156 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.128+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.156 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.131+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.156 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.131+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.156 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.132+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.157 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.132+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.157 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.132+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.157 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.133+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.157 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.133+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.157 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.134+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.158 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.134+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.158 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.134+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.158 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.135+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.158 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.135+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.135+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.135+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.136+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.136+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.164 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.136+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.165 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.137+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.165 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.138+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.165 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.138+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.165 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.139+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.166 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.140+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.166 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.140+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.166 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.141+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.166 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.141+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.141+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.141+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.142+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.142+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.142+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.168 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.143+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.168 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.144+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.168 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.144+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.168 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.144+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.169 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.145+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.169 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.145+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.169 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.147+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.169 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.148+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.169 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.148+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.170 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.148+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.170 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.149+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.170 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.149+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.170 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.149+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.171 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.149+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.171 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.149+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.171 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.150+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.171 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.150+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.171 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.150+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.150+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.151+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.151+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.152+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.152+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.173 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.154+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.173 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.154+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.173 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.155+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.175 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.155+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.175 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.155+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.175 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.155+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.176 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.155+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.176 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.156+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.177 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.156+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.177 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.157+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.177 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.157+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.186 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.157+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.187 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.158+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.187 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.158+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.187 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.158+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.187 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.158+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.188 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.159+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.188 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.159+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.188 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.159+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.188 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.160+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.160+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.160+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.160+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.161+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.161+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.190 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.161+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:56.162+0000 7f07b625a700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x55af9b0d80b0 msgr2=0x7f0798039340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:56.197 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.164+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.164+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.165+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.165+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.165+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.166+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.166+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.167+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.167+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.200 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.167+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.200 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.168+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.200 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.168+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.200 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.168+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.201 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.168+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.201 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.169+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.201 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.169+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.206 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.169+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.207 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.170+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.207 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.170+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.207 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.170+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.207 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.170+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.208 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.171+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.209 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.172+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.209 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.172+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.209 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.172+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.209 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.173+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.210 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.174+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.210 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.174+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.210 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.175+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.210 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.175+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.210 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.176+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.211 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.176+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.211 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.176+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.211 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.177+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.211 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.177+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.212 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.177+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.212 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.178+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.212 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.178+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.213 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.179+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.213 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.179+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.213 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.179+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.215 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.179+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.215 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.180+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.215 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.180+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.216 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.180+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.216 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.180+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.216 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.182+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.216 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.182+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.216 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.184+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.217 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.184+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.217 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.184+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.217 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.184+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.217 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.186+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.217 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.186+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.218 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.187+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.218 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.187+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.218 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.187+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.187+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.188+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.188+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.188+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.190+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.220 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.190+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.220 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.190+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.220 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.190+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.220 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.191+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.191+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.191+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.191+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.193+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.194+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.222 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.194+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.222 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.196+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.222 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.196+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.232 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.197+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.233 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.197+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.233 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.198+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.233 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.198+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.233 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.198+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.234 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.200+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.234 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.200+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.234 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.200+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.234 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.200+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.235 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.201+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.235 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.201+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.235 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.201+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.235 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.201+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.202+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.202+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.202+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.203+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.204+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.205+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.205+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.206+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.206+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.238 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.207+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.238 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.207+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.238 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.207+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.238 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.207+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.239 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.207+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.239 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.208+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.239 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.209+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.239 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.209+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.240 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.212+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.240 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.212+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.240 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.213+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.240 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.213+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.241 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.213+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.241 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.213+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.241 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.214+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.241 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.214+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.242 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.214+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.242 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.215+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.242 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.215+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.242 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.215+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.243 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.216+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.243 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.216+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.243 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.217+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.243 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.217+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.243 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.217+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.217+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.218+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.218+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.218+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.245 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.218+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.245 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.219+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.245 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.219+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.246 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.219+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.246 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.220+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.246 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.220+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.246 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.221+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.247 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.221+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.247 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.222+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.247 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.223+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.248 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.224+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.248 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.225+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.248 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.225+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.248 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.226+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.249 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.226+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.249 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.226+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.249 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.228+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.250 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.228+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.250 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.229+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.250 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.229+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.251 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.229+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.251 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.229+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.252 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.229+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.252 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.229+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.257 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.230+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.257 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.230+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.258 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.230+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.258 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.231+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.258 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.231+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.258 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.231+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.259 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.233+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.259 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.233+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.259 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.234+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.260 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.234+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.260 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.236+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.260 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.236+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.260 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.236+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.260 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.237+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.261 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.237+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.261 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.238+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.261 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.238+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.261 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.239+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.262 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.239+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.262 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.239+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.262 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.240+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.262 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.240+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.263 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.240+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.263 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.241+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.263 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.241+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.263 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.241+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.265 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.242+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.265 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.243+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.265 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.243+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.265 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.243+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.266 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.243+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.266 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.243+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.266 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.245+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.266 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.245+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.267 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.247+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.267 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.247+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.267 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.247+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.268 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.248+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.268 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.248+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.268 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.248+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.249+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.249+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.249+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.249+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.249+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.270 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.250+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.270 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.250+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.271 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.251+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.271 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.251+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.272 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.251+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.272 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.252+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.273 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.252+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.273 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.252+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.273 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.252+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.273 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.252+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.274 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.253+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.274 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.253+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.274 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.253+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.275 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.255+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.275 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.255+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.275 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.255+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.279 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.256+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.279 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.256+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.280 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.257+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.280 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.257+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.280 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.258+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.280 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.258+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.280 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.259+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.281 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.261+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.281 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.262+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.281 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.263+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.282 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.263+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.282 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.266+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.282 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.266+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.282 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.267+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.283 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.267+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.283 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.267+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.283 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.268+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.283 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.268+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.284 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.268+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.284 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.270+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.284 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.270+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.284 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.271+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.284 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.273+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.285 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.273+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.285 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.273+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.285 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.273+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.286 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.274+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.286 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.274+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.286 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.276+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.286 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.277+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.287 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.277+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.287 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.277+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.287 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.277+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.287 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.277+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.288 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.277+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.288 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.278+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.288 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.278+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.294 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.278+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.295 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.279+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.295 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.279+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.295 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.279+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.295 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.279+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.296 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.281+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.296 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.281+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.296 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.281+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.297 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.282+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.297 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.282+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.297 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.282+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.300 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.282+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.300 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.283+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.285+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.285+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.285+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.286+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.302 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.286+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.302 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.286+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.303 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.286+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.303 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.287+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.303 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.287+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.303 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.287+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.303 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.287+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.304 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.287+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.304 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.287+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.304 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.287+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.304 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.288+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.305 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.288+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.305 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.288+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.305 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.290+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.307 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.290+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.308 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.292+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.308 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.292+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.308 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.292+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.308 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.293+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.309 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.293+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.309 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.293+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.309 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.293+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.309 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.294+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.310 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.294+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.310 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.294+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.310 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.294+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.310 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.295+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.297+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.297+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.298+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.299+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.299+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.299+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.299+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.301+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.301+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.301+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.302+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.302+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.303+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.314 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.303+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.314 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.303+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.314 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.303+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.314 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.306+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.316 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.306+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.316 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.306+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.316 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.307+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.317 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.307+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.317 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.308+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.317 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.309+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.317 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.309+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.318 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.311+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.318 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.311+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.318 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.311+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.318 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.311+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.318 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.312+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.319 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.312+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.319 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.313+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.321 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.313+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.321 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.313+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.321 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.313+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.329 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.314+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.330 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.314+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.330 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.314+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.330 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.315+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.330 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.315+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.331 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.315+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.331 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.315+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.331 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.316+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.331 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.317+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.318+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.318+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.318+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.319+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.320+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.333 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.320+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.335 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.321+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.336 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.322+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.336 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.322+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.336 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.323+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.336 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.323+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.337 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.323+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.337 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.323+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.337 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.324+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.337 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.324+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.326+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.326+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.326+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.328+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.328+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.329+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.329+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.329+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.329+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.330+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.340 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.330+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.340 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.330+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.340 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.330+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.340 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.331+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.341 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.331+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.341 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.333+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.341 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.333+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.341 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.333+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.342 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.334+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.343 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.335+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.343 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.335+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.343 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.336+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.343 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.337+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.344 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.337+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.344 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.338+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.344 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.339+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.345 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.339+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.345 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.340+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.345 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.340+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.345 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.341+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.348 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.341+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.349 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.342+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.349 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.342+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.349 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.342+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.349 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.342+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.350 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.342+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.350 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.342+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.350 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.343+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.350 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.343+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.350 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.343+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.351 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.344+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.351 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.344+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.351 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.344+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.344+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.344+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.345+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.345+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.345+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.353 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.345+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.353 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.346+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.353 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.346+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.354 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.350+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.355 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.350+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.355 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.350+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.355 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.350+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.355 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.351+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.355 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.351+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.356 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.352+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.356 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.352+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.356 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.353+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.357 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.354+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.372 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.354+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.372 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.355+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.373 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.356+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.373 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.357+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.373 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.357+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.373 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.357+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.374 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.357+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.374 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.358+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.375 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.358+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.375 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.360+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.375 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.360+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.375 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.360+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.376 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.360+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.376 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.361+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.376 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.361+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.376 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.361+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.376 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.361+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.377 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.361+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.377 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.361+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.377 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.364+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.377 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.364+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.378 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.364+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.378 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.364+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.378 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.365+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.378 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.365+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.379 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.365+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.379 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.366+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.379 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.366+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.379 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.367+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.379 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.368+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.380 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.368+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.380 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.369+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.380 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.369+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.380 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.369+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.381 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.370+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.381 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.370+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.383 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.371+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.383 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.371+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.383 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.372+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.384 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.372+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.384 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.373+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.384 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.373+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.384 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.374+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.374+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.375+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.377+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.377+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.377+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.386 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.377+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.386 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.378+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.386 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.378+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.386 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.378+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.387 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.379+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.388 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.379+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.379+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.380+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.380+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.380+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.381+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.390 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.381+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.390 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.381+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.390 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.381+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.390 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.382+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.391 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.383+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.391 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.383+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.391 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.383+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.391 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.383+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.384+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.384+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.385+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.386+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.386+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.393 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.386+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.393 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.387+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.393 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.387+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.393 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.387+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.396 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.388+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.396 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.388+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.396 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.389+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.397 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.391+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.397 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.391+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.397 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.391+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.397 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.392+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.398 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.392+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.399 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.393+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.400 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.393+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.400 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.393+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.400 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.394+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.400 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.394+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.401 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.394+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.401 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.395+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.401 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.395+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.401 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.395+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.402 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.395+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.402 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.396+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.402 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.396+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.402 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.396+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.396+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.396+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.397+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.397+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.397+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.404 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.397+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.404 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.398+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.404 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.399+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.406 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.399+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.406 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.399+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.406 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.399+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.406 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.400+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.407 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.400+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.407 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.401+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.407 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.401+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.407 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.402+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.408 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.402+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.408 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.402+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.408 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.405+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.408 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.405+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.409 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.405+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.409 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.405+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.410 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.407+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.410 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.407+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.410 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.407+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.410 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.408+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.413 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.409+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.413 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.409+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.414 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.409+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.414 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.410+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.414 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.410+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.414 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.410+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.415 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.411+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.415 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.411+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.415 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.411+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.415 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.411+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.415 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.412+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.416 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.412+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.416 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.413+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.417 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.414+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.417 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.415+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.417 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.415+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.418 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.416+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.421 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.416+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.421 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.416+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.421 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.417+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.422 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.417+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.422 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.417+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.422 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.419+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.423 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.420+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.423 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.420+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.428 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.425+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.428 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.425+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.428 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.425+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.426+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.426+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.427+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.427+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.430 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.427+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.430 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.427+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.431 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.427+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.431 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.428+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.431 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.428+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.432 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.429+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.432 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.430+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.432 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.430+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.434 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.432+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.435 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.432+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.435 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.432+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.435 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.432+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.435 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.433+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.436 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.434+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.436 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.434+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.437 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.435+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.437 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.435+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.437 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.435+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.438 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.436+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.438 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.436+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.438 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.436+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.438 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.436+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.439 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.436+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.440 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.437+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.440 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.437+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.440 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.438+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.440 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.439+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.441 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.439+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.441 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.440+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.442 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.440+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.445 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.441+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.445 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.441+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.445 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.441+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.446 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.441+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.446 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.441+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.446 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.442+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.446 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.442+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.447 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.445+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.447 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.445+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.448 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.446+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.446+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.446+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.447+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.447+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.450 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.448+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.451 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.448+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.451 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.448+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.451 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.448+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.451 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.449+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.452 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.449+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.452 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.449+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.453 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.450+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.453 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.450+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.453 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.450+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.453 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.451+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.454 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.451+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.454 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.452+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.455 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.452+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.455 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.452+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.455 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.453+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.455 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.453+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.459 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.455+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.459 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.455+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.459 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.456+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.460 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.456+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.460 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.456+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.460 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.456+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.460 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.457+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.460 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.457+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.461 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.458+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.461 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.459+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.465 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.459+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.467 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.460+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.467 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.461+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.467 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.461+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.468 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.462+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.468 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.462+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.468 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.462+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.468 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.463+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.469 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.463+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.469 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.463+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.469 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.464+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.483 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.465+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.483 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.465+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.483 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.465+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.484 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.467+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.484 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.467+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.484 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.468+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.484 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.469+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.484 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.469+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.485 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.470+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.485 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.470+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.485 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.471+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.485 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.471+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.486 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.471+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.486 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.472+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.486 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.472+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.486 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.472+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.486 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.473+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.487 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.473+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.487 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.473+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.487 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.474+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.487 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.474+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.488 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.474+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.488 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.475+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.488 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.475+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.488 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.475+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.489 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.476+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.489 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.476+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.489 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.477+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.489 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.478+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.490 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.480+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.490 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.480+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.492 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.480+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.492 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.482+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.493 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.482+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.493 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.482+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.493 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.484+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.493 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.484+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.494 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.484+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.494 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.484+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.494 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.484+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.494 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.485+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.488+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.488+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.488+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.488+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.489+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.496 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.489+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.496 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.490+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.496 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.491+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.496 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.491+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.498 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.492+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.498 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.493+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.498 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.493+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.499 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.493+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.499 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.494+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.499 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.494+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.499 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.494+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.499 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.495+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.500 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.495+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.500 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.495+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.500 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.495+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.500 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.496+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.501 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.496+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.501 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.497+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.501 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.497+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.502 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.498+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.502 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.498+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.503 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.499+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.503 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.499+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.503 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.499+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.503 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.499+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.504 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.499+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.504 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.500+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.504 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.500+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.505 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.500+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.505 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.500+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.500+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.502+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.502+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.503+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.504+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.507 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.505+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.507 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.505+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.508 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.505+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.508 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.507+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.513 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.507+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.513 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.507+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.514 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.508+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.514 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.509+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.515 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.510+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.515 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.510+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.515 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.510+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.515 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.510+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.516 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.511+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.516 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.511+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.516 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.511+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.516 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.513+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.517 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.513+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.517 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.513+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.517 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.513+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.517 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.514+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.517 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.514+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.518 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.515+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.518 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.515+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.519 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.515+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.519 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.515+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.526 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.518+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.526 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.518+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.526 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.519+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.526 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.519+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.527 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.519+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.527 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.519+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.527 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.519+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.527 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.520+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.528 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.520+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.528 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.521+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.528 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.522+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.529 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.523+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.529 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.524+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.530 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.525+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.530 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.526+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.541 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.527+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.542 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.527+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.542 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.528+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.542 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.529+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.542 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.530+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.543 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.530+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.543 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.530+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.543 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.531+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.543 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.531+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.543 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.532+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.544 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.533+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.544 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.533+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.544 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.536+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.544 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.536+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.544 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.536+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.545 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.536+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.545 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.537+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.545 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.537+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.545 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.538+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.546 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.538+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.540+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.541+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.541+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.542+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.542+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.542+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.543+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.543+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.543+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.543+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.544+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.544+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.544+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.552 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.545+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.552 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.545+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.553 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.545+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.554 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.547+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.554 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.547+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.554 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.548+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.555 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.548+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.555 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.548+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.555 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.548+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.555 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.549+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.556 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.549+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.556 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.550+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.557 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.550+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.558 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.552+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.558 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.552+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.559 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.553+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.560 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.553+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.560 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.553+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.561 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.553+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.561 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.554+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.561 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.554+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.561 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.554+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.561 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.554+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.562 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.555+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.562 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.556+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.564 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.556+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.564 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.557+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.564 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.557+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.559+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.559+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.559+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.559+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.566 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.559+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.566 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.559+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.566 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.560+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.566 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.560+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.560+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.560+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.561+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.561+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.562+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.568 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.563+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.568 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.563+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.569 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.563+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.569 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.564+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.570 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.564+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.570 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.564+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.570 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.564+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.570 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.565+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.571 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.567+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.571 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.567+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.572 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.567+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.572 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.569+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.572 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.569+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.573 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.570+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.574 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.570+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.574 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.570+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.574 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.571+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.575 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.571+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.575 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.571+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.575 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.572+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.576 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.573+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.576 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.574+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.576 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.574+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.577 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.576+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.577 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.576+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.588 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.576+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.589 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.576+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.589 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.577+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.589 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.577+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.589 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.578+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.590 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.578+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.590 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.578+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.590 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.578+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.590 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.579+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.590 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.579+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.591 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.579+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.591 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.580+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.591 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.580+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.591 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.580+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.592 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.584+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.592 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.584+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.592 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.584+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.592 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.584+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.592 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.584+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.593 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.585+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.593 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.585+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.593 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.586+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.593 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.586+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.594 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.587+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.595 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.588+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.596 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.588+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.596 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.589+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.596 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.589+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.597 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.589+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.597 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.589+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.597 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.590+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.597 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.591+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.597 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.591+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.598 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.591+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.598 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.592+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.598 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.594+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.599 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.595+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.599 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.595+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.599 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.595+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.599 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.596+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.600 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.596+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.600 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.596+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.601 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.597+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.601 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.597+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.601 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.598+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.602 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.598+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.602 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.598+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.602 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.599+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.602 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.599+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.602 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.599+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.603 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.599+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.604 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.600+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.604 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.601+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.604 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.601+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.604 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.601+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.605 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.602+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.605 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.602+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.605 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.602+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.606 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.603+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.606 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.603+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.607 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.603+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.608 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.604+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.608 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.604+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.608 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.604+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.608 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.604+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.609 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.605+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.618 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.605+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.621 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.605+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.621 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.606+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.621 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.606+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.626 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.607+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.626 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.607+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.627 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.609+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.627 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.609+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.627 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.610+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.627 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.610+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.611+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.611+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.611+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.612+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.629 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.613+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.629 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.613+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.629 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.613+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.630 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.613+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.630 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.614+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.630 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.614+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.630 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.615+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.631 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.615+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.631 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.615+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.637 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.619+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.638 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.619+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.638 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.619+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.638 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.621+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.638 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.621+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.639 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.621+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.639 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.621+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.639 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.621+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.639 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.622+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.640 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.622+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.640 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.623+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.640 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.623+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.640 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.623+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.641 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.624+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.641 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.624+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.641 INFO:teuthology.orchestra.run.smithi173.stdout: 16 16 27036 27020 6.59447 4.53125 0.00964228 0.00947008 2021-08-21T15:02:56.648 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.626+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.648 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.626+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.626+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.627+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.628+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.630+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.630+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.631+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.631+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.633+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.634+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.634+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.634+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.634+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.635+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.652 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.635+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.652 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.636+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.652 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.636+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.652 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.637+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.652 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.638+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.653 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.638+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.653 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.639+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.653 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.639+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.653 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.639+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.653 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.640+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.654 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.640+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.654 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.641+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.654 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.641+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.654 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.641+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.655 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.641+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.655 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.642+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.655 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.642+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.655 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.642+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.656 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.642+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.656 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.642+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.656 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.643+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.657 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.643+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.657 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.643+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.657 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.644+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.657 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.645+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.658 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.645+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.660 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.647+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.661 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.648+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.661 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.648+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.661 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.648+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.662 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.649+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.662 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.649+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.662 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.650+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.662 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.650+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.663 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.652+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.663 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.652+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.663 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.654+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.663 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.654+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.654+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.654+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.655+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.655+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.665 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.656+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.665 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.656+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.665 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.658+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.665 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.658+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.665 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.658+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.667 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.662+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.667 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.662+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.670 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.662+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.662+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.662+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.663+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.663+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.672 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.663+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.672 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.663+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.672 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.664+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.672 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.664+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.673 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.664+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.673 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.664+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.673 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.665+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.673 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.665+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.674 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.665+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.674 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.665+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.674 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.665+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.675 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.666+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.675 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.668+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.675 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.668+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.675 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.668+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.676 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.669+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.676 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.670+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.677 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.670+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.677 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.670+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.677 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.671+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.678 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.671+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.678 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.671+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.678 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.672+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.678 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.675+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.678 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.675+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.700 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.676+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.702 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.676+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.703 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.677+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.703 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.677+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.703 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.677+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.703 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.677+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.704 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.678+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.704 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.678+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.704 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.679+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.679+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.679+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.679+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.680+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.680+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.706 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.680+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.706 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.681+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.706 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.681+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.706 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.681+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.681+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.682+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.682+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.683+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.683+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.708 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.683+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.708 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.684+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.708 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.684+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.708 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.686+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.708 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.686+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.709 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.686+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.709 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.687+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.710 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.687+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.710 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.687+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.710 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.688+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.711 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.688+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.711 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.688+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.711 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.688+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.711 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.689+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.689+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.689+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.689+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.690+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.691+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.713 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.691+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.713 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.692+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.713 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.692+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.713 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.693+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.713 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.695+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.714 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.696+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.714 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.696+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.714 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.696+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.714 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.696+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.715 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.696+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.715 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.697+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.715 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.697+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.718 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.699+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.718 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.700+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.719 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.700+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.719 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.700+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.719 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.701+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.719 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.701+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.720 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.701+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.720 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.701+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.720 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.701+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.720 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.702+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.720 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.702+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.721 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.702+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.721 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.702+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.721 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.703+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.721 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.703+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.722 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.703+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.722 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.704+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.722 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.704+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.722 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.704+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.722 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.704+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.723 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.704+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.723 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.704+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.723 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.705+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.723 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.705+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.724 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.705+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.724 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.705+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.724 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.706+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.724 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.706+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.724 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.707+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.725 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.707+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.725 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.707+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.725 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.708+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.725 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.708+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.725 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.708+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.726 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.710+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.726 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.711+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.726 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.711+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.726 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.712+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.727 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.712+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.727 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.712+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.727 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.712+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.727 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.712+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.727 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.714+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.728 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.715+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.728 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.715+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.728 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.715+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.728 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.715+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.728 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.716+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.729 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.716+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.729 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.716+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.729 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.716+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.729 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.716+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.731 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.718+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.731 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.718+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.731 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.718+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.732 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.718+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.732 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.719+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.732 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.719+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.732 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.719+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.732 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.721+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.733 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.722+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.734 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.722+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.734 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.723+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.734 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.724+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.734 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.724+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.735 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:02:56.732+0000 7f07ada59700 0 -- 172.21.15.173:0/3747469107 >> [v2:172.21.15.173:6816/31935,v1:172.21.15.173:6817/31935] conn(0x7f0798035f10 msgr2=0x7f0798038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:02:56.736 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.725+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.737 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.726+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.737 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.726+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.737 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.726+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.737 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.726+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.738 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.726+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.738 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.727+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.738 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.727+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.738 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.727+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.738 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.727+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.739 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.727+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.739 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.729+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.739 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.730+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.739 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.730+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.740 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.730+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.741 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.732+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.742 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.732+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.742 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.733+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.742 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.733+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.742 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.733+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.743 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.734+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.743 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.735+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.743 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.736+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.743 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.736+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.743 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.736+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.744 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.736+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.744 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.737+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.744 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.737+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.744 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.738+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.745 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.738+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.745 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.740+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.745 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.740+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.745 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.741+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.747 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.741+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.747 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.741+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.748 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.741+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.748 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.742+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.748 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.742+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.748 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.742+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.749 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.742+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.749 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.743+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.749 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.744+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.749 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.744+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.744+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.744+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.744+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.745+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.745+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.751 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.745+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.754 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.749+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.755 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.749+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.749+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.750+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.750+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.750+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.751+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.757 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.752+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.757 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.752+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.757 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.753+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.757 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.753+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.768 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.754+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.768 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.754+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.768 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.754+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.769 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.756+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.770 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.756+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.770 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.757+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.770 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.758+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.770 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.758+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.771 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.758+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.771 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.759+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.771 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.761+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.771 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.762+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.772 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.762+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.772 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.764+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.772 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.764+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.772 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.764+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.772 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.764+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.773 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.764+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.773 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.764+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.773 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.765+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.773 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.766+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.775 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.766+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.766+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.767+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.768+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.768+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.768+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.777 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.768+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.777 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.768+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.777 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.769+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.777 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.769+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.778 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.771+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.778 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.771+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.778 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.772+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.778 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.772+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.778 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.772+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.779 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.773+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.779 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.774+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.779 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.774+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.779 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.774+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.780 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.775+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.780 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.775+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.781 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.776+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.781 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.778+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.781 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.778+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.781 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.779+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.786 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.780+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.787 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.781+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.787 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.781+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.787 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.781+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.787 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.782+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.788 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.782+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.788 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.782+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.788 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.783+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.788 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.783+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.788 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.783+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.789 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.783+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.789 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.783+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.789 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.784+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.789 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.784+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.790 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.784+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.790 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.784+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.791 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.785+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.791 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.785+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.791 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.785+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.793 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.785+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.793 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.785+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.793 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.785+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.793 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.786+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.794 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.787+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.794 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.787+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.794 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.788+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.794 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.788+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.795 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.788+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.795 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.789+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.795 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.789+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.795 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.789+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.795 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.790+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.796 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.790+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.796 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.793+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.796 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.793+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.797 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.793+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.797 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.795+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.797 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.795+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.798 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.795+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.798 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.795+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.798 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.796+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.799 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.796+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.799 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.796+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.800 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.797+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.801 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.798+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.801 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.798+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.802 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.799+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.802 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.799+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.802 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.799+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.808 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.801+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.809 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.802+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.809 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.802+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.809 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.804+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.809 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.804+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.809 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.804+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.810 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.804+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.810 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.804+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.810 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.805+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.805+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.806+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.806+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.806+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.806+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.806+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.807+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.822 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.808+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.808+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.809+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.812+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.812+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.812+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.813+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.814+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.814+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.824 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.814+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.825 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.814+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.825 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.814+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.825 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.815+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.825 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.815+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.825 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.816+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.826 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.817+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.826 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.817+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.826 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.819+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.826 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.819+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.819+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.819+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.819+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.820+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.827 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.820+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.820+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.821+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.821+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.821+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.830 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.822+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.823+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.823+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.825+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.832 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.825+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.832 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.825+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.832 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.825+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.832 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.826+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.832 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.826+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.833 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.826+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.833 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.827+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.833 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.827+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.833 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.828+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.834 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.829+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.834 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.829+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.835 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.829+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.835 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.830+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.835 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.830+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.835 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.831+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.836 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.833+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.836 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.833+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.836 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.833+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.840 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.834+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.840 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.834+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.840 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.835+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.841 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.835+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.841 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.836+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.841 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.836+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.841 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.836+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.841 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.837+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.842 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.837+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.842 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.837+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.842 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.838+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.843 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.838+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.843 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.838+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.843 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.839+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.843 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.839+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.845 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.842+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.845 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.842+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.845 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.842+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.845 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.842+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.846 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.843+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.846 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.843+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.847 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.846+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.850 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.846+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.851 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.847+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.851 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.848+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.851 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.848+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.851 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.849+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.851 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.849+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.852 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.849+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.852 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.849+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.852 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.850+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.854 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.850+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.857 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.850+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.857 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.850+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.858 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.851+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.858 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.851+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.858 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.852+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.858 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.853+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.859 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.853+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.859 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.853+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.859 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.853+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.859 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.853+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.859 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.854+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.860 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.854+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.860 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.854+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.860 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.854+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.860 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.854+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.861 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.856+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.861 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.856+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.861 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.856+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.864 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.858+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.864 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.858+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.858+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.858+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.859+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.865 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.859+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.866 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.859+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.866 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.861+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.866 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.861+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.866 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.861+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.866 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.862+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.867 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.862+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.867 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.862+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.867 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.862+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.867 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.863+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.868 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.863+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.868 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.863+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.868 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.863+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.869 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.864+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.869 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.864+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.869 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.865+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.870 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.865+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.870 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.865+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.870 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.866+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.871 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.866+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.871 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.866+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.871 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.866+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.871 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.867+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.872 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.867+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.872 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.868+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.873 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.868+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.874 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.868+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.875 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.868+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.875 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.869+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.875 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.869+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.875 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.870+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.870+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.870+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.871+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.871+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.876 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.871+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.871+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.872+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.872+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.877 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.872+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.878 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.875+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.879 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.875+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.879 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.875+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.879 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.875+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.879 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.875+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.879 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.876+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.880 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.876+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.880 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.878+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.881 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.879+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.883 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.880+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.883 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.880+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.884 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.880+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.884 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.881+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.884 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.881+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.885 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.881+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.885 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.882+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.886 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.882+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.886 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.883+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.886 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.883+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.886 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.884+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.887 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.884+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.887 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.884+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.887 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.884+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.888 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.885+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.889 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.886+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.889 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.886+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.889 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.886+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.890 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.888+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.891 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.888+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.891 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.888+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.892 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.889+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.892 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.889+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.892 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.890+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.893 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.891+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.893 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.891+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.895 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.893+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.895 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.893+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.896 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.894+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.896 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.894+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.896 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.894+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.897 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.894+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.897 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.894+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.897 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.894+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.898 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.896+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.898 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.896+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.898 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.896+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.899 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.896+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.899 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.897+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.899 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.897+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.900 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.898+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.900 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.898+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.901 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.899+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.903 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.900+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.903 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.901+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.904 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.901+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.904 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.901+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.904 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.902+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.904 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.902+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.905 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.902+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.906 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.902+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.906 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.903+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.906 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.903+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.907 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.903+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.907 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.904+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.908 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.905+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.908 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.905+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.908 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.905+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.908 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.906+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.909 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.907+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.909 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.907+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.909 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.907+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.911 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.907+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.912 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.907+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.912 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.909+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.912 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.909+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.912 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.909+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.913 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.909+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.913 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.910+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.913 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.910+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.913 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.910+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.914 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.911+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.914 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.911+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.915 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.912+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.915 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.913+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.915 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.913+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.916 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.914+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.916 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.915+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.921 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.916+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.921 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.916+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.921 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.916+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.921 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.916+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.917+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.917+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.917+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.922 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.917+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.917+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.917+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.918+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.918+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.923 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.919+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.924 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.919+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.924 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.920+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.920+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.920+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.921+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.921+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.925 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.921+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.926 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.921+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.926 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.922+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.926 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.922+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.926 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.922+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.927 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.922+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.927 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.923+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.927 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.923+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.928 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.924+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.928 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.925+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.928 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.925+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.929 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.926+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.929 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.927+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.929 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.927+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.930 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.927+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.939 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.927+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.940 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.927+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.940 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.927+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.940 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.928+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.940 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.928+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.941 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.928+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.941 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.928+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.941 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.929+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.941 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.929+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.942 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.929+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.942 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.929+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.942 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.930+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.942 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.930+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.943 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.930+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.943 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.930+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.944 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.930+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.944 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.931+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.945 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.932+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.945 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.932+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.945 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.932+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.945 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.933+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.933+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.933+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.933+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.933+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.946 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.933+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.947 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.934+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.949 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.934+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.950 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.934+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.950 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.935+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.950 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.935+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.951 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.936+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.951 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.936+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.952 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.937+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.952 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.937+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.952 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.938+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.953 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.938+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.953 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.938+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.953 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.939+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.953 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.940+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.953 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.940+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.954 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.940+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.954 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.940+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.954 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.940+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.954 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.941+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.954 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.941+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.955 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.941+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.955 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.942+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.955 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.943+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.955 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.943+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.956 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.943+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.956 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.944+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.956 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.944+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.956 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.944+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.957 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.944+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.957 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.945+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.958 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.945+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.958 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.946+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.959 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.946+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.959 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.947+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.959 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.947+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.959 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.947+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.961 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.950+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.962 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.950+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.962 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.951+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.962 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.951+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.962 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.951+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.963 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.951+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.963 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.953+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.963 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.953+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.963 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.953+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.963 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.954+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.964 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.954+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.964 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.955+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.964 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.955+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.964 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.955+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.964 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.955+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.965 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.956+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.965 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.956+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.965 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.957+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.965 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.957+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.965 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.957+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.966 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.958+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.966 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.960+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.967 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.960+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.967 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.960+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.967 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.961+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.968 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.961+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.968 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.961+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.968 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.963+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.968 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.963+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.969 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.965+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.969 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.965+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.969 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.965+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.970 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.967+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.970 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.967+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.970 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.967+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.971 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.968+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.971 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.968+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.972 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.970+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.972 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.970+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.972 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.970+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.973 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.971+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.974 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.971+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.974 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.971+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.974 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.971+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.976 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.974+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.976 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.975+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.978 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.975+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.978 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.975+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.978 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.976+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.979 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.976+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.979 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.977+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.981 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.977+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.981 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.977+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.981 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.978+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.982 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.979+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.982 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.979+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.982 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.981+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.983 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.981+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.983 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.981+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.986 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.983+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.991 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.985+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.991 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.985+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.991 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.985+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.992 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.985+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.992 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.986+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.992 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.986+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.992 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.987+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.993 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.988+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.993 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.988+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.993 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.989+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.998 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.991+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.999 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.991+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.999 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.991+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.999 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.992+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:56.999 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.992+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.992+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.992+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.993+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.993+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.000 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.994+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.001 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.994+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.001 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.994+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.001 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.994+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.001 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.994+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.001 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.995+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.002 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.995+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.002 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.995+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.002 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.995+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.002 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.996+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.003 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.996+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.003 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.996+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.003 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.997+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.003 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.997+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.006 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.997+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.007 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.998+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.007 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.998+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.007 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.998+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.007 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.998+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.008 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.999+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.008 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.999+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.008 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.999+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.008 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.999+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.009 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:56.999+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.009 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.000+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.010 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.001+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.011 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.002+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.011 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.002+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.015 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.003+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.016 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.003+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.016 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.004+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.030 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.004+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.032 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.005+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.032 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.005+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.032 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.005+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.032 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.006+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.033 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.006+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.033 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.007+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.033 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.007+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.033 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.007+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.033 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.007+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.034 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.008+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.034 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.008+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.034 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.009+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.034 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.009+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.035 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.009+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.035 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.009+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.035 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.010+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.035 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.010+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.036 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.010+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.036 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.011+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.036 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.011+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.036 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.012+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.036 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.012+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.037 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.012+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.037 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.014+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.037 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.014+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.037 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.014+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.038 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.017+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.038 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.018+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.038 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.020+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.039 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.020+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.039 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.020+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.039 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.021+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.039 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.021+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.039 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.021+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.040 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.022+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.040 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.022+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.040 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.023+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.040 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.023+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.047 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.023+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.048 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.024+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.048 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.024+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.048 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.024+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.048 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.025+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.049 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.025+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.049 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.025+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.049 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.027+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.049 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.027+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.049 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.027+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.050 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.027+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.051 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.028+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.051 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.028+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.052 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.029+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.068 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.029+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.069 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.030+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.070 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.030+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.070 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.031+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.070 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.031+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.070 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.031+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.071 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.032+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.071 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.032+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.071 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.032+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.071 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.033+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.071 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.033+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.072 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.038+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.072 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.038+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.072 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.038+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.072 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.038+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.073 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.040+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.073 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.040+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.073 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.040+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.073 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.040+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.073 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.042+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.042+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.042+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.043+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.043+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.074 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.044+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.075 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.045+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.075 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.045+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.075 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.046+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.075 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.046+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.077 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.046+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.077 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.046+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.078 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.046+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.078 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.047+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.078 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.049+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.079 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.049+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.079 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.049+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.079 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.049+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.079 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.049+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.080 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.050+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.080 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.050+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.080 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.050+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.080 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.050+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.080 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.051+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.081 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.051+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.081 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.051+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.081 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.051+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.081 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.052+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.082 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.052+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.082 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.053+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.082 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.053+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.082 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.053+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.083 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.055+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.083 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.055+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.083 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.055+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.084 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.058+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.085 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.058+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.085 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.058+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.085 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.059+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.086 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.059+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.086 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.059+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.086 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.060+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.087 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.061+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.087 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.061+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.087 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.061+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.088 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.062+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.088 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.062+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.089 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.063+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.089 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.063+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.089 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.063+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.089 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.064+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.089 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.065+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.090 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.065+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.090 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.066+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.090 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.066+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.091 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.067+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.097 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.068+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.097 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.068+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.097 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.069+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.098 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.069+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.098 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.070+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.098 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.070+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.098 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.070+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.099 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.071+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.099 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.071+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.099 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.071+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.099 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.072+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.099 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.074+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.100 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.075+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.100 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.075+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.100 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.075+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.100 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.076+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.101 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.076+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.101 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.076+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.101 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.077+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.101 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.077+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.102 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.077+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.102 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.077+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.103 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.077+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.103 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.077+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.103 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.078+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.104 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.078+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.104 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.078+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.105 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.078+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.105 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.078+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.105 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.078+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.105 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.082+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.106 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.082+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.106 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.082+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.107 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.082+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.107 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.083+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.107 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.083+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.107 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.085+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.108 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.086+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.108 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.087+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.108 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.087+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.108 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.087+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.088+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.090+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.090+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.090+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.109 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.091+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.110 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.091+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.110 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.092+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.110 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.093+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.110 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.093+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.110 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.094+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.113 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.094+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.113 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.095+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.095+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.095+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.095+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.096+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.114 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.097+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.097+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.099+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.099+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.115 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.099+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.116 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.099+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.116 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.099+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.116 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.100+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.116 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.100+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.118 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.101+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.118 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.102+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.118 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.102+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.118 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.104+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.119 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.104+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.104+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.104+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.104+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.120 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.105+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.105+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.106+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.106+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.107+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.121 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.108+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.124 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.108+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.124 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.108+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.124 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.109+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.125 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.109+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.128 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.112+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.128 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.112+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.129 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.112+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.129 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.114+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.130 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.114+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.130 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.114+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.130 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.115+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.130 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.115+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.131 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.117+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.131 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.118+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.131 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.118+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.131 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.119+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.131 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.119+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.132 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.119+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.132 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.121+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.132 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.121+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.132 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.121+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.133 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.121+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.133 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.122+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.133 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.122+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.133 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.125+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.133 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.125+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.134 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.125+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.136 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.125+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.136 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.126+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.137 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.126+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.143 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.127+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.127+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.127+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.127+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.144 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.127+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.145 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.127+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.145 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.128+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.145 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.128+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.145 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.129+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.129+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.130+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.130+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.130+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.146 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.130+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.147 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.131+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.147 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.131+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.147 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.132+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.147 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.134+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.134+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.135+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.135+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.135+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.148 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.136+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.149 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.136+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.149 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.137+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.149 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.138+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.149 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.138+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.150 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.139+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.150 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.139+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.150 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.140+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.151 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.140+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.151 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.140+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.151 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.140+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.151 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.142+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.153 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.143+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.153 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.143+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.144+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.145+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.145+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.154 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.145+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.146+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.146+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.147+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.147+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.155 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.147+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.156 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.148+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.156 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.148+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.158 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.148+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.149+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.149+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.149+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.149+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.159 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.150+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.160 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.150+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.160 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.150+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.160 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.150+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.161 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.154+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.162 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.154+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.162 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.154+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.162 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.154+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.162 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.154+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.163 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.155+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.163 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.155+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.163 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.155+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.163 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.157+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.166 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.158+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.166 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.158+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.166 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.158+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.158+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.158+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.158+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.158+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.167 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.159+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.168 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.159+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.168 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.159+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.168 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.160+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.168 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.162+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.169 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.162+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.169 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.162+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.171 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.162+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.171 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.163+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.171 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.163+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.164+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.164+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.164+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.164+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.172 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.164+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.173 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.165+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.173 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.165+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.173 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.165+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.173 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.166+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.173 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.167+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.174 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.167+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.174 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.167+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.174 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.167+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.174 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.168+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.176 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.170+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.176 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.170+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.176 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.170+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.176 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.171+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.177 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.171+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.177 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.171+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.177 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.173+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.177 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.173+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.180 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.175+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.180 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.175+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.180 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.176+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.181 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.176+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.181 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.176+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.181 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.177+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.183 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.177+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.184 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.178+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.184 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.179+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.184 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.180+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.186 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.180+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.186 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.180+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.187 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.181+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.187 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.181+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.187 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.182+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.187 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.183+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.183+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.185+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.185+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.189 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.185+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.190 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.185+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.190 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.186+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.190 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.186+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.197 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.188+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.188+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.189+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.189+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.198 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.189+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.189+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.190+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.190+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.190+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.199 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.191+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.200 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.191+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.200 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.191+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.200 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.191+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.200 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.192+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.201 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.192+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.201 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.192+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.201 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.193+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.201 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.193+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.201 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.193+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.202 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.194+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.202 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.195+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.202 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.196+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.202 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.196+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.202 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.196+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.203 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.196+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.203 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.197+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.206 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.197+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.206 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.197+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.207 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.197+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.207 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.198+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.207 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.198+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.207 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.198+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.208 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.198+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.208 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.199+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.208 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.199+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.208 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.199+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.209 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.199+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.209 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.200+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.214 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.200+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.214 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.203+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.214 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.204+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.215 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.204+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.218 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.204+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.204+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.205+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.205+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.219 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.205+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.220 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.205+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.220 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.205+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.220 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.206+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.220 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.206+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.206+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.207+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.207+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.221 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.208+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.222 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.209+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.222 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.210+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.222 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.210+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.222 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.210+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.223 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.211+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.223 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.211+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.223 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.211+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.223 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.211+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.223 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.211+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.224 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.212+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.224 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.212+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.224 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.212+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.224 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.212+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.225 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.213+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.225 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.213+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.225 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.213+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.225 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.214+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.225 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.214+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.226 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.214+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.226 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.214+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.226 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.214+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.226 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.215+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.227 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.217+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.229 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.219+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.229 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.219+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.229 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.219+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.229 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.220+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.230 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.220+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.230 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.220+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.230 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.221+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.230 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.221+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.231 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.222+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.231 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.224+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.231 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.225+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.231 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.225+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.231 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.227+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.232 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.227+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.233 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.227+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.234 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.227+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.234 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.227+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.234 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.227+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.235 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.228+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.235 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.228+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.235 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.228+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.235 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.228+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.229+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.229+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.229+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.236 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.230+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.230+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.230+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.230+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.230+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.237 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.231+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.238 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.231+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.238 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.231+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.238 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.231+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.238 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.231+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.239 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.232+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.239 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.232+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.243 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.234+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.243 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.234+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.243 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.235+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.235+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.236+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.237+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.237+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.244 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.238+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.245 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.238+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.245 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.238+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.245 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.239+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.245 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.239+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.245 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.239+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.246 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.240+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.246 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.241+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.246 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.241+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.248 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.243+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.248 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.243+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.248 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.243+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.249 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.244+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.249 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.245+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.250 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.245+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.250 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.245+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.250 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.245+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.250 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.246+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.251 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.247+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.252 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.247+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.252 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.247+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.252 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.248+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.253 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.248+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.253 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.248+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.254 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.250+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.258 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.251+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.258 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.251+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.267 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.253+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.268 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.253+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.268 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.253+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.268 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.254+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.268 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.254+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.254+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.254+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.255+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.255+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.269 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.255+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.270 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.255+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.270 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.256+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.270 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.256+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.270 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.256+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.271 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.256+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.271 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.256+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.271 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.256+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.271 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.256+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.271 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.257+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.272 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.257+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.275 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.259+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.275 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.259+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.276 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.260+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.276 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.261+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.279 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.261+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.279 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.261+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.279 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.263+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.279 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.263+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.280 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.263+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.280 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.263+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.280 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.265+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.281 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.265+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.281 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.266+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.281 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.267+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.281 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.267+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.281 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.267+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.282 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.268+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.282 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.268+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.283 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.268+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.283 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.268+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.283 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.269+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.284 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.269+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.284 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.270+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.284 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.270+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.285 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.273+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.289 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.275+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.289 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.275+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.290 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.277+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.290 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.277+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.290 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.277+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.290 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.277+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.291 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.278+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.291 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.278+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.291 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.278+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.291 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.279+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.291 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.279+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.292 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.280+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.292 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.280+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.292 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.281+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.292 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.281+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.292 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.281+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.293 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.281+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.293 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.282+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.293 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.282+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.293 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.283+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.294 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.283+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.294 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.284+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.294 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.284+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.294 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.285+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.295 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.286+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.295 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.288+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.299 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.289+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.299 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.289+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.299 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.291+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.299 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.292+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.299 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.292+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.300 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.292+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.300 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.292+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.300 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.292+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.300 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.293+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.293+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.293+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.293+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.294+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.301 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.294+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.302 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.294+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.302 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.295+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.302 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.295+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.302 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.295+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.303 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.296+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.303 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.296+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.307 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.298+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.308 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.298+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.309 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.299+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.309 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.299+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.309 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.299+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.310 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.300+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.310 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.300+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.310 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.300+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.310 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.300+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.300+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.300+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.301+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.301+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.311 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.301+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.301+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.302+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.302+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.304+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.312 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.304+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.304+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.304+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.304+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.305+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.313 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.305+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.314 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.306+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.314 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.306+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.314 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.306+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.317 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.307+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.318 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.308+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.318 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.308+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.318 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.308+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.319 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.308+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.319 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.309+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.320 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.309+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.320 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.309+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.320 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.310+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.320 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.310+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.321 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.310+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.321 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.311+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.323 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.311+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.323 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.311+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.323 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.312+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.323 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.312+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.324 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.312+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.324 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.312+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.325 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.313+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.325 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.313+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.325 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.313+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.326 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.314+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.326 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.314+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.326 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.314+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.329 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.315+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.329 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.316+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.329 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.316+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.329 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.316+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.330 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.316+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.330 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.317+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.331 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.318+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.331 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.318+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.319+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.319+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.319+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.320+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.332 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.320+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.333 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.320+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.333 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.321+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.333 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.321+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.334 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.322+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.334 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.322+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.334 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.322+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.336 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.323+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.336 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.323+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.337 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.323+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.337 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.324+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.337 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.324+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.337 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.324+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.325+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.325+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.325+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.338 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.326+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.326+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.326+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.327+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.339 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.327+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.340 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.328+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.340 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.328+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.342 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.329+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.342 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.329+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.342 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.330+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.343 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.332+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.343 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.332+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.343 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.332+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.343 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.332+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.344 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.333+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.344 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.333+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.344 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.334+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.344 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.335+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.345 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.336+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.345 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.336+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.345 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.336+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.345 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.336+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.346 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.337+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.346 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.337+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.346 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.337+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.347 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.338+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.347 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.338+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.347 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.338+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.347 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.338+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.348 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.340+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.349 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.341+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.349 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.341+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.349 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.342+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.349 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.342+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.350 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.342+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.351 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.344+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.345+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.346+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.347+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.352 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.347+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.353 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.347+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.353 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.348+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.353 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.348+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.353 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.348+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.354 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.349+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.354 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.349+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.354 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.349+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.354 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.350+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.355 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.350+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.355 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.350+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.355 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.351+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.356 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.351+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.356 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.352+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.357 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.353+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.371 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.354+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.372 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.354+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.383 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.356+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.384 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.356+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.384 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.356+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.384 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.357+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.384 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.357+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.357+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.358+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.358+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.385 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.358+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.386 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.358+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.387 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.359+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.387 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.360+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.387 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.360+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.388 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.360+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.388 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.360+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.388 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.361+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.388 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.361+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.361+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.362+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.363+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.363+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.389 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.363+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.390 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.363+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.390 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.364+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.390 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.364+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.390 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.364+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.391 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.365+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.391 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.365+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.391 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.365+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.391 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.365+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.365+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.367+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.367+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.367+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.392 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.367+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.393 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.368+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.393 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.368+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.393 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.368+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.393 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.369+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.394 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.369+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.394 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.369+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.394 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.369+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.394 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.370+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.395 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.370+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.395 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.373+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.395 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.373+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.395 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.374+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.395 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.374+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.396 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.375+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.396 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.376+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.396 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.376+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.396 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.377+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.397 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.378+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.397 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.378+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.397 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.378+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.397 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.378+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.398 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.379+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.401 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.382+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.401 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.383+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.402 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.383+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.402 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.384+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.402 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.384+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.402 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.384+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.384+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.385+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.385+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.385+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.403 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.385+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.404 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.385+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.404 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.385+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.404 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.387+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.404 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.387+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.405 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.387+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.405 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.387+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.405 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.387+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.406 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.388+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.406 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.388+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.406 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.388+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.406 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.389+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.407 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.389+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.407 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.390+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.407 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.390+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.407 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.391+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.408 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.391+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.408 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.391+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.408 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.393+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.409 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.394+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.409 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.394+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.409 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.394+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.410 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.394+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.410 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.395+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.410 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.395+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.410 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.395+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.411 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.395+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.418 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.396+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.419 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.396+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.419 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.396+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.419 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.397+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.420 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.397+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.420 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.397+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.420 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.398+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.420 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.398+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.420 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.398+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.421 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.398+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.421 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.399+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.421 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.399+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.421 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.399+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.422 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.400+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.422 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.400+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.427 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.400+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.427 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.401+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.427 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.401+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.428 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.402+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.428 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.402+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.428 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.405+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.428 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.406+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.406+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.406+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.406+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.407+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.429 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.408+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.430 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.408+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.430 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.408+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.430 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.409+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.430 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.410+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.431 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.410+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.431 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.413+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.431 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.413+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.431 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.414+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.432 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.415+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.432 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.416+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.432 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.416+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.432 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.417+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.433 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.417+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.433 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.418+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.433 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.419+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.433 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.419+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.434 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.419+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.434 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.420+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.434 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.420+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.434 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.420+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.434 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.421+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.435 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.421+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.435 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.421+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.435 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.422+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.435 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.422+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.436 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.422+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.436 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.423+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.436 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.423+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.436 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.424+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.436 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.425+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.437 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.425+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.437 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.426+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.437 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.426+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.438 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.427+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.439 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.427+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.439 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.427+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.439 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.429+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.439 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.429+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.440 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.429+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.441 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.431+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.441 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.432+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.441 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.432+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.442 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.432+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.442 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.432+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.442 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.432+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.442 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.432+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.443 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.432+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.443 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.433+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.443 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.433+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.443 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.433+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.443 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.434+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.444 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.434+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.444 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.434+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.444 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.434+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.444 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.434+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.444 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.435+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.445 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.435+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.445 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.436+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.445 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.438+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.445 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.438+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.446 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.438+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.447 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.440+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.447 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.441+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.448 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.442+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.448 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.442+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.448 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.444+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.448 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.444+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.444+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.444+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.445+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.445+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.449 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.446+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.450 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.446+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.450 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.446+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.451 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.446+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.451 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.450+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.451 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.450+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.452 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.450+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.452 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.451+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.453 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.451+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.453 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.452+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.455 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.452+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.455 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.452+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.456 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.453+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.456 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.453+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.456 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.453+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.458 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.454+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.458 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.454+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.458 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.454+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.458 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.455+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.459 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.455+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.459 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.455+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.459 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.456+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.459 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.456+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.469 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.458+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.470 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.458+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.470 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.458+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.470 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.459+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.470 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.459+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.471 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.461+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.471 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.461+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.471 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.461+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.471 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.463+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.472 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.463+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.472 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.463+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.472 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.463+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.472 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.463+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.473 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.464+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.473 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.464+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.473 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.464+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.473 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.465+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.473 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.465+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.474 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.465+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.474 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.466+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.474 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.466+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.475 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.467+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.475 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.468+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.476 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.470+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.476 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.470+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.476 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.470+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.477 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.468+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.477 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.471+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.477 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.471+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.477 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.474+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.478 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.474+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.478 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.474+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.479 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.476+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.479 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.477+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.480 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.477+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.480 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.477+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.480 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.477+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.480 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.478+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.481 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.478+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.481 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.478+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.481 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.478+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.482 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.480+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.482 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.480+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.483 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.480+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.483 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.481+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.483 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.481+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.483 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.481+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.484 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.482+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.489 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.483+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.490 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.483+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.491 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.483+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.491 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.483+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.491 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.484+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.492 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.484+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.492 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.485+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.493 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.485+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.493 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.487+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.493 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.487+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.493 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.487+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.494 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.488+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.489+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.489+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.489+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.495 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.489+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.496 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.489+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.496 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.490+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.499 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.491+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.499 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.491+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.500 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.491+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.500 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.491+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.500 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.492+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.500 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.492+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.501 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.495+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.501 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.495+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.501 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.495+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.501 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.496+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.502 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.496+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.502 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.496+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.502 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.496+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.502 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.496+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.497+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.497+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.498+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.506 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.498+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.507 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.498+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.507 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.498+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.508 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.498+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.508 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.499+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.509 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.499+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.509 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.501+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.509 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.501+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.509 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.502+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.510 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.502+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.510 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.502+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.510 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.502+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.510 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.502+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.511 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.503+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.511 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.503+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.511 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.503+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.512 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.507+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.512 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.508+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.513 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.508+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.513 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.508+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.513 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.509+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.513 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.509+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.514 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.511+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.514 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.512+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.515 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.512+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.516 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.513+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.516 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.513+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.516 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.514+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.516 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.515+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.517 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.515+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.517 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.516+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.520 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.517+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.520 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.517+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.520 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.517+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.521 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.518+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.521 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.518+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.522 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.519+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.522 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.519+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.522 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.520+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.525 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.521+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.526 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.521+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.526 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.522+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.527 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.522+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.527 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.522+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.527 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.522+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.528 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.523+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.529 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.523+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.529 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.523+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.530 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.523+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.530 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.524+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.530 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.524+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.530 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.524+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.531 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.525+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.531 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.526+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.532 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.526+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.532 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.527+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.532 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.528+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.532 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.529+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.533 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.529+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.533 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.530+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.533 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.530+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.533 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.531+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.544 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.531+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.544 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.531+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.545 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.532+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.545 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.532+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.545 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.532+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.545 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.533+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.546 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.533+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.546 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.533+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.546 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.534+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.546 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.534+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.547 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.534+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.547 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.534+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.548 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.535+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.548 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.535+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.548 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.536+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.548 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.537+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.537+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.538+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.539+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.539+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.549 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.539+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.540+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.540+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.540+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.550 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.541+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.541+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.541+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.541+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.542+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.551 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.542+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.552 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.542+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.552 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.542+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.555 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.543+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.556 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.544+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.556 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.545+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.556 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.545+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.556 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.545+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.557 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.546+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.557 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.546+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.557 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.546+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.557 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.546+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.557 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.546+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.558 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.546+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.558 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.547+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.558 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.548+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.559 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.548+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.559 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.549+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.559 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.549+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.559 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.549+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.559 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.550+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.560 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.550+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.560 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.551+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.560 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.552+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.560 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.552+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.561 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.552+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.562 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.554+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.563 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.554+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.563 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.554+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.563 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.554+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.563 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.554+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.564 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.555+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.564 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.555+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.555+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.556+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.556+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.556+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.565 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.556+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.566 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.556+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.566 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.556+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.566 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.557+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.566 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.557+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.557+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.557+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.558+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.558+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.567 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.560+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.568 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.560+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.569 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.561+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.569 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.561+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.570 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.562+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.570 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.562+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.570 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.562+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.570 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.562+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.571 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.562+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.571 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.563+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.571 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.563+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.572 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.563+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.572 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.564+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.573 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.564+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.573 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.564+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.573 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.564+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.573 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.565+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.574 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.567+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.574 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.567+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.574 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.568+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.575 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.568+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.575 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.568+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.576 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.568+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.576 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.568+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.576 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.569+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.577 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.569+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.577 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.571+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.577 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.571+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.577 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.571+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.581 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.573+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.582 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.573+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.582 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.574+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.584 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.574+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.584 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.574+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.584 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.574+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.584 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.575+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.585 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.575+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.585 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.576+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.585 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.576+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.586 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.576+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.593 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.577+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.594 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.577+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.594 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.577+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.595 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.579+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.596 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.579+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.596 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.579+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.609 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.580+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.609 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.580+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.610 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.582+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.610 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.582+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.610 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.583+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.610 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.583+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.610 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.584+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.611 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.584+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.611 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.585+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.611 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.587+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.611 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.587+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.612 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.587+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.612 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.587+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.612 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.588+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.612 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.588+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.612 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.588+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.613 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.588+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.613 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.588+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.614 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.589+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.614 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.590+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.614 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.590+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.614 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.591+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.615 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.591+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.615 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.592+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.615 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.593+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.619 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.594+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.619 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.595+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.619 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.595+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.620 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.596+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.620 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.597+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.620 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.597+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.621 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.597+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.621 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.599+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.621 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.599+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.621 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.599+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.622 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.600+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.622 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.600+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.622 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.600+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.623 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.601+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.624 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.601+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.624 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.601+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.624 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.601+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.625 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.601+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.625 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.601+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.625 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.602+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.625 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.602+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.626 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.602+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.626 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.602+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.626 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.602+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.626 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.603+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.627 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.603+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.627 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.603+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.627 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.603+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.627 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.603+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.604+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.604+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.605+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.605+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.628 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.606+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.629 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.607+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.629 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.607+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.629 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.608+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.631 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.609+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.631 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.610+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.631 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.611+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.631 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.611+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.632 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.612+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.632 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.613+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.632 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.613+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.632 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.613+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.632 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.613+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.633 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.614+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.633 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.614+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.634 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.614+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.634 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.615+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.634 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.615+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.635 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.615+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.635 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.615+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.635 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.616+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.635 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.618+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.636 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.618+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.636 INFO:teuthology.orchestra.run.smithi173.stdout: 17 16 28195 28179 6.47288 4.52734 0.0125479 0.00964792 2021-08-21T15:02:57.640 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.620+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.641 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.620+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.641 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.621+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.642 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.621+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.642 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.621+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.642 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.621+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.642 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.621+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.643 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.622+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.643 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.623+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.643 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.623+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.643 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.625+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.644 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.625+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.644 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.625+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.644 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.627+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.644 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.627+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.644 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.627+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.645 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.628+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.645 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.629+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.645 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.629+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.645 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.629+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.646 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.630+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.646 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.630+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.646 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.630+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.647 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.631+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.647 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.631+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.647 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.632+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.647 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.632+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.647 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.632+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.648 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.632+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.648 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.633+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.648 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.633+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.648 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.634+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.635+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.635+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.635+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.635+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.649 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.635+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.636+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.636+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.636+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.650 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.637+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.637+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.637+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.638+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.638+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.651 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.638+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.654 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.639+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.655 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.639+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.655 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.641+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.655 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.641+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.655 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.642+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.656 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.642+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.656 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.643+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.656 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.644+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.656 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.644+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.656 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.645+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.657 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.645+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.657 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.647+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.657 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.647+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.658 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.648+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.658 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.648+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.658 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.648+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.658 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.649+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.659 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.649+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.659 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.649+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.659 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.650+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.660 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.650+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.660 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.650+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.660 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.651+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.660 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.652+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.660 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.652+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.661 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.653+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.663 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.653+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.663 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.653+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.663 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.654+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.663 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.654+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.654+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.655+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.656+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.657+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.664 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.657+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.665 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.657+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.665 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.657+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.665 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.658+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.666 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.658+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.666 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.658+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.666 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.659+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.666 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.659+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.667 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.660+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.667 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.662+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.668 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.662+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.669 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.663+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.669 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.663+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.669 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.663+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.669 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.664+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.670 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.664+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.670 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.664+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.670 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.665+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.670 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.665+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.665+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.666+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.666+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.666+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.671 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.667+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.672 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.667+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.673 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.668+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.673 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.669+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.674 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.669+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.675 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.669+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.675 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.669+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.675 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.670+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.675 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.670+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.676 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.670+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.676 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.671+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.676 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.671+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.677 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.671+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.678 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.672+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.679 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.673+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.679 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.673+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.679 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.674+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.679 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.674+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.680 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.674+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.680 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.674+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.680 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.674+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.680 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.675+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.680 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.676+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.681 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.676+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.681 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.676+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.681 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.676+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.681 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.676+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.689 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.679+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.693 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.680+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.693 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.680+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.693 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.682+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.694 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.682+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.694 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.683+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.695 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.683+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.695 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.684+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.696 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.684+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.696 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.684+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.697 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.685+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.697 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.685+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.697 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.686+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.698 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.686+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.698 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.686+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.702 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.687+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.703 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.689+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.703 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.689+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.703 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.689+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.703 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.689+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.704 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.690+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.704 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.690+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.704 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.690+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.704 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.691+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.691+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.692+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.692+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.692+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.705 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.695+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.706 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.695+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.706 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.696+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.706 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.696+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.706 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.697+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.697+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.698+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.698+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.707 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.699+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.708 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.699+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.709 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.699+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.709 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.700+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.709 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.700+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.710 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.700+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.710 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.700+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.710 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.700+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.710 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.701+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.711 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.702+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.711 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.703+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.711 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.703+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.711 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.703+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.704+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.704+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.707+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.708+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.712 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.708+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.715 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.708+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.716 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.709+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.716 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.709+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.716 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.710+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.717 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.710+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.717 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.710+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.717 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.710+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.717 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.711+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.718 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.711+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.718 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.712+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.718 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.712+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.720 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.714+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.721 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.714+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.721 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.715+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.721 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.715+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.722 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.716+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.723 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.716+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.723 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.717+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.723 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.718+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.724 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.718+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.724 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.718+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.724 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.719+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.725 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.721+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.731 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.721+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.732 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.721+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.732 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.722+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.733 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.722+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.733 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.723+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.733 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.723+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.733 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.723+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.733 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.723+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.734 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.724+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.734 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.724+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.735 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.724+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.735 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.724+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.735 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.725+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.735 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.725+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.735 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.725+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.736 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.725+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.736 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.726+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.736 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.727+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.736 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.728+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.737 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.728+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.737 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.729+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.739 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.730+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.739 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.730+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.739 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.731+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.740 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.731+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.740 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.733+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.740 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.733+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.740 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.734+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.740 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.734+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.741 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.734+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.741 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.734+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.741 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.734+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.742 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.735+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.742 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.735+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.742 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.736+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.743 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.737+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.743 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.737+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.744 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.737+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.744 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.737+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.744 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.738+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.744 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.738+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.745 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.738+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.745 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.739+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.746 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.739+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.746 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.739+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.746 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.740+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.746 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.740+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.746 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.740+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.747 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.741+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.747 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.741+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.747 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.741+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.747 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.742+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.748 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.742+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.748 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.742+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.748 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.742+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.748 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.743+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.745+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.745+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.745+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.750 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.745+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.751 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.745+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.751 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.746+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.751 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.746+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.753 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.748+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.754 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.748+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.754 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.749+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.754 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.749+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.754 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.749+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.755 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.749+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.755 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.749+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.755 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.749+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.755 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.749+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.755 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.749+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.750+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.750+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.750+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.756 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.750+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.757 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.751+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.757 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.751+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.757 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.752+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.759 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.753+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.759 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.753+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.759 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.753+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.759 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.754+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.760 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.754+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.760 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.754+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.760 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.755+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.760 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.755+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.760 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.757+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.761 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.757+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.761 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.757+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.762 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.759+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.762 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.759+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.762 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.759+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.766 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.760+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.767 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.760+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.767 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.761+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.767 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.762+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.767 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.762+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.768 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.763+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.768 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.764+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.769 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.764+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.769 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.764+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.769 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.765+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.769 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.765+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.769 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.765+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.770 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.766+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.771 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.766+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.771 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.766+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.772 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.766+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.772 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.767+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.775 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.768+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.775 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.768+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.775 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.768+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.775 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.769+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.769+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.769+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.769+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.776 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.770+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.777 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.770+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.777 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.771+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.777 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.771+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.777 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.771+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.778 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.772+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.778 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.774+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.778 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.774+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.780 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.775+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.780 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.775+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.780 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.775+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.781 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.776+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.781 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.776+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.785 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.778+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.786 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.778+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.786 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.779+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.786 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.780+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.787 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.780+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.787 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.780+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.788 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.781+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.788 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.781+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.788 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.781+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.790 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.781+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.790 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.782+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.791 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.782+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.791 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.783+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.791 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.783+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.791 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.783+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.792 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.783+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.792 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.784+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.792 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.784+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.792 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.784+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.793 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.784+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.794 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.786+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.794 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.786+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.794 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.786+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.797 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.786+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.797 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.787+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.797 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.787+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.797 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.789+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.798 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.789+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.798 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.789+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.798 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.790+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.798 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.790+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.798 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.790+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.799 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.791+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.799 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.791+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.799 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.791+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.799 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.792+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.800 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.792+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.800 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.792+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.800 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.792+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.801 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.792+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.801 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.792+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.802 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.792+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.802 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.793+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.802 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.793+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.802 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.793+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.803 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.793+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.803 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.793+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.803 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.797+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.804 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.797+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.804 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.797+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.804 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.797+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.804 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.797+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.804 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.798+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.805 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.798+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.805 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.798+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.805 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.799+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.805 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.799+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.805 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.799+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.806 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.801+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.807 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.801+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.807 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.801+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.807 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.802+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.807 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.802+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.808 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.802+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.808 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.803+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.808 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.803+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.808 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.804+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.808 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.804+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.809 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.804+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.809 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.805+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.810 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.806+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.810 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.806+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.810 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.806+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.810 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.807+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.811 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.807+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.811 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.807+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.811 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.807+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.812 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.807+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.812 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.807+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.812 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.808+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.813 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.808+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.815 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.808+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.815 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.810+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.815 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.810+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.815 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.811+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.815 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.811+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.816 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.812+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.816 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.812+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.816 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.812+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.818 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.814+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.818 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.814+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.815+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.819 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.816+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.816+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.816+0000 7f31ff822700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.816+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.820 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.817+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.821 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.817+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.822 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.818+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.818+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.823 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.818+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.825 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.819+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.826 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.819+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.826 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.819+0000 7f31fe01f700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.826 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.820+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.826 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.820+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.821+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.822+0000 7f31f9816700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.822+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.828 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.822+0000 7f31fc81c700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.829 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.824+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.829 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.824+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.829 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.825+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.829 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.825+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.830 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.825+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.830 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.826+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.829+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.829+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.831 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.829+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.838 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.831+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.838 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.833+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.839 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.833+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.839 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.834+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.839 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.834+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.841 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.834+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.842 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.835+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.844 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.836+0000 7f31fe820700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.844 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.836+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.844 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.837+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.844 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.838+0000 7f31fa017700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.845 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.838+0000 7f31f8814700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.845 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.839+0000 7f31fc01b700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.845 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.840+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.846 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.840+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.846 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.840+0000 7f31fd81e700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.846 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.840+0000 7f31fb81a700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.846 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.841+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.847 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.841+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.847 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.841+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.848 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.841+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.848 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.841+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.848 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-08-21T15:02:57.849 INFO:teuthology.orchestra.run:waiting for 300 2021-08-21T15:02:57.850 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.845+0000 7f31fa818700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.850 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.845+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.850 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.846+0000 7f320c03b700 -1 bdev(0x55f7e2295000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.851 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:02:57.847+0000 7f31f8013700 -1 bdev(0x55f7e2294000 /var/lib/ceph/osd/ceph-1/block) aio_write objectstore_blackhole=true, throwing out IO 2021-08-21T15:02:57.888 INFO:tasks.ceph.osd.1:Stopped 2021-08-21T15:02:57.889 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-08-21T15:02:57.889 INFO:teuthology.orchestra.run:waiting for 300 2021-08-21T15:02:57.970 INFO:tasks.ceph.osd.2:Stopped 2021-08-21T15:02:58.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2021-08-21T15:02:58.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2021-08-21T15:02:58.625 INFO:teuthology.orchestra.run.smithi173.stdout: 18 16 28466 28450 6.17215 1.05859 0.00660052 0.00968711 2021-08-21T15:02:59.624 INFO:teuthology.orchestra.run.smithi173.stdout: 19 16 28466 28450 5.84737 0 - 0.00968711 2021-08-21T15:02:59.972 INFO:tasks.ceph.osd.1:Restarting daemon 2021-08-21T15:02:59.973 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-08-21T15:02:59.976 INFO:tasks.ceph.osd.1:Started 2021-08-21T15:02:59.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2021-08-21T15:03:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:no valid command found; 10 closest matches: 2021-08-21T15:03:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:0 2021-08-21T15:03:00.107 INFO:teuthology.orchestra.run.smithi173.stderr:1 2021-08-21T15:03:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:2 2021-08-21T15:03:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:abort 2021-08-21T15:03:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:assert 2021-08-21T15:03:00.108 INFO:teuthology.orchestra.run.smithi173.stderr:config diff 2021-08-21T15:03:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:config diff get 2021-08-21T15:03:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:config get 2021-08-21T15:03:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:config help [] 2021-08-21T15:03:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:config set ... 2021-08-21T15:03:00.109 INFO:teuthology.orchestra.run.smithi173.stderr:admin_socket: invalid command 2021-08-21T15:03:00.111 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-08-21T15:03:00.111 INFO:tasks.osd_recovery.ceph_manager:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2021-08-21T15:03:00.577 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:03:00.575+0000 7fbae84e60c0 -1 Falling back to public interface 2021-08-21T15:03:00.624 INFO:teuthology.orchestra.run.smithi173.stdout:2021-08-21T15:03:00.625069+0000 min lat: 0.00187303 max lat: 0.0343798 avg lat: 0.00968711 2021-08-21T15:03:00.625 INFO:teuthology.orchestra.run.smithi173.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-08-21T15:03:00.625 INFO:teuthology.orchestra.run.smithi173.stdout: 20 16 28466 28450 5.55507 0 - 0.00968711 2021-08-21T15:03:01.624 INFO:teuthology.orchestra.run.smithi173.stdout: 21 16 28466 28450 5.29059 0 - 0.00968711 2021-08-21T15:03:02.627 INFO:teuthology.orchestra.run.smithi173.stdout: 22 16 28466 28450 5.05014 0 - 0.00968711 2021-08-21T15:03:03.259 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:03:03.255+0000 7fbae84e60c0 -1 bluestore::NCB::restore_allocator::No Valid allocation info on disk (empty file) 2021-08-21T15:03:03.625 INFO:teuthology.orchestra.run.smithi173.stdout: 23 16 28466 28450 4.83061 0 - 0.00968711 2021-08-21T15:03:03.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2021-08-21T15:03:03.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2021-08-21T15:03:04.509 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:03:04.508+0000 7fbae84e60c0 -1 bluestore::NCB::restore_allocator::No Valid allocation info on disk (empty file) 2021-08-21T15:03:04.626 INFO:teuthology.orchestra.run.smithi173.stdout: 24 16 28466 28450 4.62936 0 - 0.00968711 2021-08-21T15:03:05.113 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2021-08-21T15:03:05.238 INFO:teuthology.orchestra.run.smithi173.stderr:no valid command found; 10 closest matches: 2021-08-21T15:03:05.238 INFO:teuthology.orchestra.run.smithi173.stderr:0 2021-08-21T15:03:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:1 2021-08-21T15:03:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:2 2021-08-21T15:03:05.239 INFO:teuthology.orchestra.run.smithi173.stderr:abort 2021-08-21T15:03:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:assert 2021-08-21T15:03:05.241 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs debug_inject_read_zeros 2021-08-21T15:03:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs files list 2021-08-21T15:03:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs stats 2021-08-21T15:03:05.242 INFO:teuthology.orchestra.run.smithi173.stderr:bluestore allocator dump block 2021-08-21T15:03:05.243 INFO:teuthology.orchestra.run.smithi173.stderr:bluestore allocator fragmentation block 2021-08-21T15:03:05.243 INFO:teuthology.orchestra.run.smithi173.stderr:admin_socket: invalid command 2021-08-21T15:03:05.248 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-08-21T15:03:05.249 INFO:tasks.osd_recovery.ceph_manager:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2021-08-21T15:03:05.590 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:03:05.589+0000 7fbae84e60c0 -1 osd.1 19 log_to_monitors {default=true} 2021-08-21T15:03:05.625 INFO:teuthology.orchestra.run.smithi173.stdout: 25 16 28466 28450 4.44422 0 - 0.00968711 2021-08-21T15:03:05.646 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:03:05.646+0000 7fbad7837700 -1 osd.1 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-21T15:03:06.625 INFO:teuthology.orchestra.run.smithi173.stdout: 26 16 28466 28450 4.27332 0 - 0.00968711 2021-08-21T15:03:07.625 INFO:teuthology.orchestra.run.smithi173.stdout: 27 16 28466 28450 4.11506 0 - 0.00968711 2021-08-21T15:03:08.634 INFO:teuthology.orchestra.run.smithi173.stdout: 28 16 28466 28450 3.96811 0 - 0.00968711 2021-08-21T15:03:09.625 INFO:teuthology.orchestra.run.smithi173.stdout: 29 6 28466 28460 3.83264 0.00355114 11.655 0.0137773 2021-08-21T15:03:10.251 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2021-08-21T15:03:10.375 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2021-08-21T15:03:10.376 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [ 2021-08-21T15:03:10.376 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.376 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4367.0:28445 1.7 1.7aa549f (undecoded) ondisk+retry+write+known_if_redirected e22)", 2021-08-21T15:03:10.376 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2021-08-21T15:03:07.647060+0000", 2021-08-21T15:03:10.376 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 2.7263104060000001, 2021-08-21T15:03:10.377 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7263283110000001, 2021-08-21T15:03:10.377 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2021-08-21T15:03:10.377 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "delayed", 2021-08-21T15:03:10.377 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2021-08-21T15:03:10.378 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4367", 2021-08-21T15:03:10.378 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/3747469107", 2021-08-21T15:03:10.378 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 28445 2021-08-21T15:03:10.379 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.379 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2021-08-21T15:03:10.379 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.380 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2021-08-21T15:03:10.380 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647060+0000", 2021-08-21T15:03:10.380 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.380 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.380 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.381 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2021-08-21T15:03:10.381 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647060+0000", 2021-08-21T15:03:10.381 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.381 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.382 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.382 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2021-08-21T15:03:10.382 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647068+0000", 2021-08-21T15:03:10.382 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.1080000000000004e-06 2021-08-21T15:03:10.382 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.383 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.383 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2021-08-21T15:03:10.383 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647070+0000", 2021-08-21T15:03:10.384 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.018e-06 2021-08-21T15:03:10.384 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.386 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.386 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2021-08-21T15:03:10.386 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647078+0000", 2021-08-21T15:03:10.387 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.3680000000000002e-06 2021-08-21T15:03:10.387 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.387 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.388 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2021-08-21T15:03:10.388 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647083+0000", 2021-08-21T15:03:10.388 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2460000000000003e-06 2021-08-21T15:03:10.388 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.389 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.389 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2021-08-21T15:03:10.390 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647266+0000", 2021-08-21T15:03:10.390 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00018297300000000001 2021-08-21T15:03:10.390 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.390 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.390 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2021-08-21T15:03:10.391 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647275+0000", 2021-08-21T15:03:10.391 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.3519999999999996e-06 2021-08-21T15:03:10.391 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.391 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2021-08-21T15:03:10.392 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.392 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.392 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.392 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4367.0:28453 1.7 1.b55bd297 (undecoded) ondisk+retry+write+known_if_redirected e22)", 2021-08-21T15:03:10.392 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2021-08-21T15:03:07.647130+0000", 2021-08-21T15:03:10.393 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 2.7262407230000001, 2021-08-21T15:03:10.393 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7263032410000001, 2021-08-21T15:03:10.393 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2021-08-21T15:03:10.393 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "delayed", 2021-08-21T15:03:10.394 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2021-08-21T15:03:10.394 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4367", 2021-08-21T15:03:10.394 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/3747469107", 2021-08-21T15:03:10.394 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 28453 2021-08-21T15:03:10.394 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.395 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2021-08-21T15:03:10.395 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.395 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2021-08-21T15:03:10.395 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647130+0000", 2021-08-21T15:03:10.396 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.396 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.396 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.396 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2021-08-21T15:03:10.396 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647130+0000", 2021-08-21T15:03:10.397 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.397 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.397 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.397 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2021-08-21T15:03:10.398 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647137+0000", 2021-08-21T15:03:10.399 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.832e-06 2021-08-21T15:03:10.400 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.400 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.400 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2021-08-21T15:03:10.401 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647139+0000", 2021-08-21T15:03:10.401 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9010000000000001e-06 2021-08-21T15:03:10.401 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.401 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.401 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2021-08-21T15:03:10.402 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647146+0000", 2021-08-21T15:03:10.402 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.3119999999999996e-06 2021-08-21T15:03:10.402 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.402 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.404 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2021-08-21T15:03:10.404 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647151+0000", 2021-08-21T15:03:10.404 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.5159999999999996e-06 2021-08-21T15:03:10.404 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.404 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.405 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2021-08-21T15:03:10.405 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647295+0000", 2021-08-21T15:03:10.405 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000144771 2021-08-21T15:03:10.405 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.405 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.406 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2021-08-21T15:03:10.406 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647301+0000", 2021-08-21T15:03:10.406 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.5480000000000001e-06 2021-08-21T15:03:10.407 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.407 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2021-08-21T15:03:10.407 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.407 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.408 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.416 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4367.0:28454 1.7 1.f3ddbdcf (undecoded) ondisk+retry+write+known_if_redirected e22)", 2021-08-21T15:03:10.417 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2021-08-21T15:03:07.647156+0000", 2021-08-21T15:03:10.417 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 2.726214723, 2021-08-21T15:03:10.417 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7263153959999999, 2021-08-21T15:03:10.417 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2021-08-21T15:03:10.418 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "delayed", 2021-08-21T15:03:10.418 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2021-08-21T15:03:10.418 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4367", 2021-08-21T15:03:10.418 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/3747469107", 2021-08-21T15:03:10.420 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 28454 2021-08-21T15:03:10.420 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.421 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2021-08-21T15:03:10.421 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.421 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2021-08-21T15:03:10.421 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647156+0000", 2021-08-21T15:03:10.421 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.422 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.422 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.422 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2021-08-21T15:03:10.422 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647156+0000", 2021-08-21T15:03:10.423 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.423 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.423 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.423 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2021-08-21T15:03:10.423 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647161+0000", 2021-08-21T15:03:10.424 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.3149999999999999e-06 2021-08-21T15:03:10.424 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.424 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.424 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2021-08-21T15:03:10.424 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647164+0000", 2021-08-21T15:03:10.425 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7590000000000002e-06 2021-08-21T15:03:10.425 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.425 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.425 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2021-08-21T15:03:10.426 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647173+0000", 2021-08-21T15:03:10.426 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 8.6899999999999998e-06 2021-08-21T15:03:10.426 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.426 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.427 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2021-08-21T15:03:10.427 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647178+0000", 2021-08-21T15:03:10.427 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0379999999999999e-06 2021-08-21T15:03:10.428 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.428 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.428 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2021-08-21T15:03:10.428 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647322+0000", 2021-08-21T15:03:10.428 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000143626 2021-08-21T15:03:10.429 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.429 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.429 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2021-08-21T15:03:10.429 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647327+0000", 2021-08-21T15:03:10.430 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.2989999999999996e-06 2021-08-21T15:03:10.430 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.430 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2021-08-21T15:03:10.431 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.431 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.431 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.431 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4367.0:28456 1.7 1.3685bdf7 (undecoded) ondisk+retry+write+known_if_redirected e22)", 2021-08-21T15:03:10.432 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2021-08-21T15:03:07.647183+0000", 2021-08-21T15:03:10.432 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 2.7261875409999998, 2021-08-21T15:03:10.432 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.726328514, 2021-08-21T15:03:10.432 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2021-08-21T15:03:10.432 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "delayed", 2021-08-21T15:03:10.433 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2021-08-21T15:03:10.433 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4367", 2021-08-21T15:03:10.433 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/3747469107", 2021-08-21T15:03:10.433 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 28456 2021-08-21T15:03:10.433 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.434 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2021-08-21T15:03:10.434 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.434 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2021-08-21T15:03:10.434 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647183+0000", 2021-08-21T15:03:10.435 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.435 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.435 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.435 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2021-08-21T15:03:10.435 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647183+0000", 2021-08-21T15:03:10.436 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.436 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.436 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.436 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2021-08-21T15:03:10.437 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647189+0000", 2021-08-21T15:03:10.437 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.4369999999999998e-06 2021-08-21T15:03:10.438 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.438 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.438 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2021-08-21T15:03:10.438 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647191+0000", 2021-08-21T15:03:10.439 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.9810000000000002e-06 2021-08-21T15:03:10.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.439 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.439 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2021-08-21T15:03:10.439 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647200+0000", 2021-08-21T15:03:10.440 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 9.6309999999999998e-06 2021-08-21T15:03:10.440 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.440 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.440 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2021-08-21T15:03:10.441 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647205+0000", 2021-08-21T15:03:10.441 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.6380000000000003e-06 2021-08-21T15:03:10.441 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.442 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.442 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2021-08-21T15:03:10.442 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647346+0000", 2021-08-21T15:03:10.442 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000140798 2021-08-21T15:03:10.442 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.443 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.443 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2021-08-21T15:03:10.443 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647351+0000", 2021-08-21T15:03:10.443 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9579999999999998e-06 2021-08-21T15:03:10.444 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.444 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2021-08-21T15:03:10.444 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.444 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.444 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.445 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4367.0:28461 1.7 1.1982a3cf (undecoded) ondisk+retry+write+known_if_redirected e22)", 2021-08-21T15:03:10.445 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2021-08-21T15:03:07.647401+0000", 2021-08-21T15:03:10.445 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 2.7259702030000001, 2021-08-21T15:03:10.445 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7261482450000001, 2021-08-21T15:03:10.445 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2021-08-21T15:03:10.446 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "delayed", 2021-08-21T15:03:10.446 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2021-08-21T15:03:10.446 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4367", 2021-08-21T15:03:10.446 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/3747469107", 2021-08-21T15:03:10.447 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 28461 2021-08-21T15:03:10.447 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.447 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2021-08-21T15:03:10.447 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.448 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2021-08-21T15:03:10.448 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647401+0000", 2021-08-21T15:03:10.448 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.449 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.449 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.449 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2021-08-21T15:03:10.449 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647401+0000", 2021-08-21T15:03:10.449 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.450 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.450 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.450 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2021-08-21T15:03:10.450 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647405+0000", 2021-08-21T15:03:10.451 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.1679999999999997e-06 2021-08-21T15:03:10.451 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.452 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.452 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2021-08-21T15:03:10.452 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647407+0000", 2021-08-21T15:03:10.452 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.951e-06 2021-08-21T15:03:10.452 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.453 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.453 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2021-08-21T15:03:10.453 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647414+0000", 2021-08-21T15:03:10.453 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 7.272e-06 2021-08-21T15:03:10.454 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.454 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.454 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2021-08-21T15:03:10.454 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647419+0000", 2021-08-21T15:03:10.455 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.0159999999999999e-06 2021-08-21T15:03:10.455 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.455 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.455 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2021-08-21T15:03:10.455 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647590+0000", 2021-08-21T15:03:10.456 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.000170855 2021-08-21T15:03:10.456 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.456 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.456 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2021-08-21T15:03:10.457 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647596+0000", 2021-08-21T15:03:10.457 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.5889999999999999e-06 2021-08-21T15:03:10.457 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.457 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2021-08-21T15:03:10.457 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.458 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.458 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.459 INFO:teuthology.orchestra.run.smithi173.stdout: "description": "osd_op(client.4367.0:28462 1.7 1.ada8227f (undecoded) ondisk+retry+write+known_if_redirected e22)", 2021-08-21T15:03:10.459 INFO:teuthology.orchestra.run.smithi173.stdout: "initiated_at": "2021-08-21T15:03:07.647427+0000", 2021-08-21T15:03:10.459 INFO:teuthology.orchestra.run.smithi173.stdout: "age": 2.7259437129999999, 2021-08-21T15:03:10.459 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 2.7261574290000001, 2021-08-21T15:03:10.459 INFO:teuthology.orchestra.run.smithi173.stdout: "type_data": { 2021-08-21T15:03:10.460 INFO:teuthology.orchestra.run.smithi173.stdout: "flag_point": "delayed", 2021-08-21T15:03:10.460 INFO:teuthology.orchestra.run.smithi173.stdout: "client_info": { 2021-08-21T15:03:10.460 INFO:teuthology.orchestra.run.smithi173.stdout: "client": "client.4367", 2021-08-21T15:03:10.460 INFO:teuthology.orchestra.run.smithi173.stdout: "client_addr": "172.21.15.173:0/3747469107", 2021-08-21T15:03:10.461 INFO:teuthology.orchestra.run.smithi173.stdout: "tid": 28462 2021-08-21T15:03:10.461 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.461 INFO:teuthology.orchestra.run.smithi173.stdout: "events": [ 2021-08-21T15:03:10.462 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.462 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "initiated", 2021-08-21T15:03:10.462 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647427+0000", 2021-08-21T15:03:10.462 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.463 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.463 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.463 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "throttled", 2021-08-21T15:03:10.463 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647427+0000", 2021-08-21T15:03:10.463 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0 2021-08-21T15:03:10.464 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.464 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.464 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "header_read", 2021-08-21T15:03:10.464 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647432+0000", 2021-08-21T15:03:10.464 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 5.3680000000000001e-06 2021-08-21T15:03:10.465 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.465 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.465 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "all_read", 2021-08-21T15:03:10.465 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647434+0000", 2021-08-21T15:03:10.466 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 1.2920000000000001e-06 2021-08-21T15:03:10.466 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.466 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.466 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "dispatched", 2021-08-21T15:03:10.466 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647440+0000", 2021-08-21T15:03:10.467 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 6.2160000000000003e-06 2021-08-21T15:03:10.467 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.467 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.467 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "queued_for_pg", 2021-08-21T15:03:10.467 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647444+0000", 2021-08-21T15:03:10.468 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.138e-06 2021-08-21T15:03:10.468 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.468 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.469 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "reached_pg", 2021-08-21T15:03:10.469 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647615+0000", 2021-08-21T15:03:10.469 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 0.00017045 2021-08-21T15:03:10.469 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2021-08-21T15:03:10.470 INFO:teuthology.orchestra.run.smithi173.stdout: { 2021-08-21T15:03:10.470 INFO:teuthology.orchestra.run.smithi173.stdout: "event": "waiting for peered", 2021-08-21T15:03:10.470 INFO:teuthology.orchestra.run.smithi173.stdout: "time": "2021-08-21T15:03:07.647619+0000", 2021-08-21T15:03:10.470 INFO:teuthology.orchestra.run.smithi173.stdout: "duration": 4.9019999999999998e-06 2021-08-21T15:03:10.470 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.471 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2021-08-21T15:03:10.471 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.471 INFO:teuthology.orchestra.run.smithi173.stdout: } 2021-08-21T15:03:10.471 INFO:teuthology.orchestra.run.smithi173.stdout: ], 2021-08-21T15:03:10.472 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 6 2021-08-21T15:03:10.472 INFO:teuthology.orchestra.run.smithi173.stdout:} 2021-08-21T15:03:10.625 INFO:teuthology.orchestra.run.smithi173.stdout: 30 6 28466 28460 3.7049 0 - 0.0137773 2021-08-21T15:03:11.632 INFO:teuthology.orchestra.run.smithi173.stdout: 31 6 28466 28460 3.5854 0 - 0.0137773 2021-08-21T15:03:12.625 INFO:teuthology.orchestra.run.smithi173.stdout: 32 6 28466 28460 3.47337 0 - 0.0137773 2021-08-21T15:03:13.626 INFO:teuthology.orchestra.run.smithi173.stdout: 33 6 28466 28460 3.36813 0 - 0.0137773 2021-08-21T15:03:14.626 INFO:teuthology.orchestra.run.smithi173.stdout: 34 6 28466 28460 3.26908 0 - 0.0137773 2021-08-21T15:03:15.626 INFO:teuthology.orchestra.run.smithi173.stdout: 35 6 28466 28460 3.17569 0 - 0.0137773 2021-08-21T15:03:16.626 INFO:teuthology.orchestra.run.smithi173.stdout: 36 6 28466 28460 3.08748 0 - 0.0137773 2021-08-21T15:03:17.626 INFO:teuthology.orchestra.run.smithi173.stdout: 37 6 28466 28460 3.00405 0 - 0.0137773 2021-08-21T15:03:18.626 INFO:teuthology.orchestra.run.smithi173.stdout: 38 6 28466 28460 2.925 0 - 0.0137773 2021-08-21T15:03:19.078 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:19.075+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:19.626 INFO:teuthology.orchestra.run.smithi173.stdout: 39 6 28466 28460 2.85001 0 - 0.0137773 2021-08-21T15:03:20.099 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:20.099+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:20.627 INFO:teuthology.orchestra.run.smithi173.stdout:2021-08-21T15:03:20.627074+0000 min lat: 0.00187303 max lat: 11.6639 avg lat: 0.0137773 2021-08-21T15:03:20.627 INFO:teuthology.orchestra.run.smithi173.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-08-21T15:03:20.627 INFO:teuthology.orchestra.run.smithi173.stdout: 40 6 28466 28460 2.77876 0 - 0.0137773 2021-08-21T15:03:21.125 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:21.122+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:21.630 INFO:teuthology.orchestra.run.smithi173.stdout: 41 6 28466 28460 2.71099 0 - 0.0137773 2021-08-21T15:03:22.089 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:22.088+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:22.626 INFO:teuthology.orchestra.run.smithi173.stdout: 42 6 28466 28460 2.64645 0 - 0.0137773 2021-08-21T15:03:23.098 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:23.098+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:23.627 INFO:teuthology.orchestra.run.smithi173.stdout: 43 6 28466 28460 2.58491 0 - 0.0137773 2021-08-21T15:03:24.107 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:24.102+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:24.627 INFO:teuthology.orchestra.run.smithi173.stdout: 44 6 28466 28460 2.52617 0 - 0.0137773 2021-08-21T15:03:25.138 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:25.136+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:25.627 INFO:teuthology.orchestra.run.smithi173.stdout: 45 6 28466 28460 2.47004 0 - 0.0137773 2021-08-21T15:03:26.155 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:26.155+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:26.630 INFO:teuthology.orchestra.run.smithi173.stdout: 46 6 28466 28460 2.41635 0 - 0.0137773 2021-08-21T15:03:27.114 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:27.112+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:27.627 INFO:teuthology.orchestra.run.smithi173.stdout: 47 6 28466 28460 2.36494 0 - 0.0137773 2021-08-21T15:03:28.091 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:28.089+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:28.589 INFO:tasks.ceph.osd.1.smithi173.stderr:2021-08-21T15:03:28.588+0000 7fbad903a700 -1 osd.1 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 ever on either front or back, first ping sent 2021-08-21T15:03:08.492072+0000 (oldest deadline 2021-08-21T15:03:28.492072+0000) 2021-08-21T15:03:28.627 INFO:teuthology.orchestra.run.smithi173.stdout: 48 6 28466 28460 2.31568 0 - 0.0137773 2021-08-21T15:03:29.055 INFO:tasks.ceph.osd.0.smithi173.stderr:2021-08-21T15:03:29.054+0000 7f717b21e700 -1 osd.0 24 heartbeat_check: no reply from 172.21.15.173:6820 osd.2 since back 2021-08-21T15:02:55.356434+0000 front 2021-08-21T15:02:55.355431+0000 (oldest deadline 2021-08-21T15:03:18.855520+0000) 2021-08-21T15:03:29.627 INFO:teuthology.orchestra.run.smithi173.stdout: 49 6 28466 28460 2.26842 0 - 0.0137773 2021-08-21T15:03:30.628 INFO:teuthology.orchestra.run.smithi173.stdout:Total time run: 49.9552 2021-08-21T15:03:30.629 INFO:teuthology.orchestra.run.smithi173.stdout:Total writes made: 28466 2021-08-21T15:03:30.631 INFO:teuthology.orchestra.run.smithi173.stdout:Write size: 4096 2021-08-21T15:03:30.631 INFO:teuthology.orchestra.run.smithi173.stdout:Object size: 4096 2021-08-21T15:03:30.632 INFO:teuthology.orchestra.run.smithi173.stdout:Bandwidth (MB/sec): 2.2259 2021-08-21T15:03:30.632 INFO:teuthology.orchestra.run.smithi173.stdout:Stddev Bandwidth: 3.25841 2021-08-21T15:03:30.633 INFO:teuthology.orchestra.run.smithi173.stdout:Max bandwidth (MB/sec): 10.1445 2021-08-21T15:03:30.633 INFO:teuthology.orchestra.run.smithi173.stdout:Min bandwidth (MB/sec): 0 2021-08-21T15:03:30.633 INFO:teuthology.orchestra.run.smithi173.stdout:Average IOPS: 569 2021-08-21T15:03:30.633 INFO:teuthology.orchestra.run.smithi173.stdout:Stddev IOPS: 834.166 2021-08-21T15:03:30.634 INFO:teuthology.orchestra.run.smithi173.stdout:Max IOPS: 2597 2021-08-21T15:03:30.634 INFO:teuthology.orchestra.run.smithi173.stdout:Min IOPS: 0 2021-08-21T15:03:30.634 INFO:teuthology.orchestra.run.smithi173.stdout:Average Latency(s): 0.0206721 2021-08-21T15:03:30.635 INFO:teuthology.orchestra.run.smithi173.stdout:Stddev Latency(s): 0.522591 2021-08-21T15:03:30.635 INFO:teuthology.orchestra.run.smithi173.stdout:Max latency(s): 32.7322 2021-08-21T15:03:30.636 INFO:teuthology.orchestra.run.smithi173.stdout:Min latency(s): 0.00187303 2021-08-21T15:03:30.637 INFO:tasks.osd_recovery:err is 0 2021-08-21T15:03:30.637 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-08-21T15:03:30.807 INFO:teuthology.orchestra.run.smithi173.stdout:34359738385 2021-08-21T15:03:30.808 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-08-21T15:03:30.968 INFO:teuthology.orchestra.run.smithi173.stdout:94489280519 2021-08-21T15:03:30.969 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-08-21T15:03:31.290 INFO:teuthology.orchestra.run.smithi173.stdout:34359738384 2021-08-21T15:03:31.304 INFO:tasks.osd_recovery.ceph_manager:need seq 34359738385 got 34359738384 for osd.0 2021-08-21T15:03:32.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-08-21T15:03:32.598 INFO:teuthology.orchestra.run.smithi173.stdout:34359738385 2021-08-21T15:03:32.611 INFO:tasks.osd_recovery.ceph_manager:need seq 34359738385 got 34359738385 for osd.0 2021-08-21T15:03:32.612 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-08-21T15:03:32.899 INFO:teuthology.orchestra.run.smithi173.stdout:94489280519 2021-08-21T15:03:32.910 INFO:tasks.osd_recovery.ceph_manager:need seq 94489280519 got 94489280519 for osd.1 2021-08-21T15:03:32.911 INFO:tasks.osd_recovery.ceph_manager:waiting for peering to complete or become blocked 2021-08-21T15:03:32.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:03:33.202 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:03:33.202 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:03:33.209 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2021-08-21T15:03:32.331386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143256,"num_objects":27868,"num_object_clones":0,"num_object_copies":55736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14572,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27868,"num_write_kb":111469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1015808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27868,"ondisk_log_size":27868,"up":12,"acting":8,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":322520,"kb_used_data":219904,"kb_used_omap":1,"kb_used_meta":102590,"kb_avail":282793000,"statfs":{"total":289910292480,"available":289580032000,"internally_reserved":0,"allocated":225181696,"data_stored":224760878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":105053128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,6],"upper_bound":65536},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":430104,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13504,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":397312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001330"},"pg_stats":[{"pgid":"1.7","version":"26'3355","reported_seq":3382,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2021-08-21T15:03:30.574485+0000","last_change":"2021-08-21T15:03:30.564746+0000","last_active":"2021-08-21T15:03:30.574485+0000","last_peered":"2021-08-21T15:03:30.574485+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:03:30.564746+0000","last_became_peered":"2021-08-21T15:03:30.564746+0000","last_unstale":"2021-08-21T15:03:30.574485+0000","last_undegraded":"2021-08-21T15:03:30.563332+0000","last_fullsized":"2021-08-21T15:03:30.563269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3355,"ondisk_log_size":3355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3355,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3355,"num_write_kb":13420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"24'3471","reported_seq":3500,"reported_epoch":25,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:03:29.565422+0000","last_change":"2021-08-21T15:03:09.497535+0000","last_active":"2021-08-21T15:03:29.565422+0000","last_peered":"2021-08-21T15:03:29.565422+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:03:29.565422+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3471,"ondisk_log_size":3471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":307,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3471,"num_write_kb":13884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3164}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"19'3524","reported_seq":3545,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2021-08-21T15:03:30.568001+0000","last_change":"2021-08-21T15:03:30.564976+0000","last_active":"2021-08-21T15:03:30.568001+0000","last_peered":"2021-08-21T15:03:30.568001+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:03:30.564976+0000","last_became_peered":"2021-08-21T15:03:30.564976+0000","last_unstale":"2021-08-21T15:03:30.568001+0000","last_undegraded":"2021-08-21T15:03:30.563945+0000","last_fullsized":"2021-08-21T15:03:30.563859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3524,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3524,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3524,"num_write_kb":14096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"24'3669","reported_seq":4191,"reported_epoch":26,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:03:30.724156+0000","last_change":"2021-08-21T15:03:09.495105+0000","last_active":"2021-08-21T15:03:30.724156+0000","last_peered":"2021-08-21T15:03:30.724156+0000","last_clean":"2021-08-21T15:02:57.838109+0000","last_became_active":"2021-08-21T15:03:09.486187+0000","last_became_peered":"2021-08-21T15:03:09.486187+0000","last_unstale":"2021-08-21T15:03:30.724156+0000","last_undegraded":"2021-08-21T15:03:09.473203+0000","last_fullsized":"2021-08-21T15:03:09.458334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3669,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":60,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3669,"num_write_kb":14676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1015808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3609}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"19'3561","reported_seq":3592,"reported_epoch":25,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:03:29.565279+0000","last_change":"2021-08-21T15:03:09.497229+0000","last_active":"2021-08-21T15:03:29.565279+0000","last_peered":"2021-08-21T15:03:29.565279+0000","last_clean":"2021-08-21T15:03:05.635315+0000","last_became_active":"2021-08-21T15:03:09.493570+0000","last_became_peered":"2021-08-21T15:03:09.493570+0000","last_unstale":"2021-08-21T15:03:29.565279+0000","last_undegraded":"2021-08-21T15:03:09.473758+0000","last_fullsized":"2021-08-21T15:03:09.458745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3561,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":286,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3561,"num_write_kb":14244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3275}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"19'3153","reported_seq":3180,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2021-08-21T15:03:30.566608+0000","last_change":"2021-08-21T15:03:30.564744+0000","last_active":"2021-08-21T15:03:30.566608+0000","last_peered":"2021-08-21T15:03:30.566608+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:03:30.564744+0000","last_became_peered":"2021-08-21T15:03:30.564744+0000","last_unstale":"2021-08-21T15:03:30.566608+0000","last_undegraded":"2021-08-21T15:03:30.563510+0000","last_fullsized":"2021-08-21T15:03:30.563438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3153,"ondisk_log_size":3153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3153,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"24'3566","reported_seq":3595,"reported_epoch":25,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:03:29.565274+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:03:29.565274+0000","last_peered":"2021-08-21T15:03:29.565274+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:03:29.565274+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3566,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3566,"num_write_kb":14264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"26'3569","reported_seq":3590,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2021-08-21T15:03:30.568342+0000","last_change":"2021-08-21T15:03:30.565579+0000","last_active":"2021-08-21T15:03:30.568342+0000","last_peered":"2021-08-21T15:03:30.568342+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:03:30.565579+0000","last_became_peered":"2021-08-21T15:03:30.565579+0000","last_unstale":"2021-08-21T15:03:30.568342+0000","last_undegraded":"2021-08-21T15:03:30.564055+0000","last_fullsized":"2021-08-21T15:03:30.563976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3569,"ondisk_log_size":3569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614552,"num_objects":3569,"num_object_clones":0,"num_object_copies":7138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3569,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3569,"num_write_kb":14273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3569}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143256,"num_objects":27868,"num_object_clones":0,"num_object_copies":55736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14572,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27868,"num_write_kb":111469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1015808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":225832960,"data_stored":225828888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27868,"ondisk_log_size":27868,"up":12,"acting":8,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86012,"kb_used_data":54836,"kb_used_omap":0,"kb_used_meta":31168,"kb_avail":94285828,"statfs":{"total":96636764160,"available":96548687872,"internally_reserved":0,"allocated":56152064,"data_stored":56034166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31916032},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.151}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124628,"kb_used_data":85644,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94247212,"statfs":{"total":96636764160,"available":96509145088,"internally_reserved":0,"allocated":87699456,"data_stored":87550663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280519,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111880,"kb_used_data":79424,"kb_used_omap":1,"kb_used_meta":32446,"kb_avail":94259960,"statfs":{"total":96636764160,"available":96522199040,"internally_reserved":0,"allocated":81330176,"data_stored":81176049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":33225672},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,6],"upper_bound":65536},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87490560,"data_stored":87486488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81125376,"data_stored":81125376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57217024,"data_stored":57217024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:03:33.211 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:03:33.495 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:03:33.497 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:03:33.512 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2021-08-21T15:03:32.331386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143256,"num_objects":27868,"num_object_clones":0,"num_object_copies":55736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14572,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27868,"num_write_kb":111469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1015808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27868,"ondisk_log_size":27868,"up":12,"acting":8,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":322520,"kb_used_data":219904,"kb_used_omap":1,"kb_used_meta":102590,"kb_avail":282793000,"statfs":{"total":289910292480,"available":289580032000,"internally_reserved":0,"allocated":225181696,"data_stored":224760878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":105053128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,6],"upper_bound":65536},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":430104,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13504,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":397312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001330"},"pg_stats":[{"pgid":"1.7","version":"26'3355","reported_seq":3382,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2021-08-21T15:03:30.574485+0000","last_change":"2021-08-21T15:03:30.564746+0000","last_active":"2021-08-21T15:03:30.574485+0000","last_peered":"2021-08-21T15:03:30.574485+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:03:30.564746+0000","last_became_peered":"2021-08-21T15:03:30.564746+0000","last_unstale":"2021-08-21T15:03:30.574485+0000","last_undegraded":"2021-08-21T15:03:30.563332+0000","last_fullsized":"2021-08-21T15:03:30.563269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3355,"ondisk_log_size":3355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3355,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3355,"num_write_kb":13420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"24'3471","reported_seq":3500,"reported_epoch":25,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:03:29.565422+0000","last_change":"2021-08-21T15:03:09.497535+0000","last_active":"2021-08-21T15:03:29.565422+0000","last_peered":"2021-08-21T15:03:29.565422+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:03:29.565422+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3471,"ondisk_log_size":3471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":307,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3471,"num_write_kb":13884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3164}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"19'3524","reported_seq":3545,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2021-08-21T15:03:30.568001+0000","last_change":"2021-08-21T15:03:30.564976+0000","last_active":"2021-08-21T15:03:30.568001+0000","last_peered":"2021-08-21T15:03:30.568001+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:03:30.564976+0000","last_became_peered":"2021-08-21T15:03:30.564976+0000","last_unstale":"2021-08-21T15:03:30.568001+0000","last_undegraded":"2021-08-21T15:03:30.563945+0000","last_fullsized":"2021-08-21T15:03:30.563859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3524,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3524,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3524,"num_write_kb":14096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"24'3669","reported_seq":4191,"reported_epoch":26,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:03:30.724156+0000","last_change":"2021-08-21T15:03:09.495105+0000","last_active":"2021-08-21T15:03:30.724156+0000","last_peered":"2021-08-21T15:03:30.724156+0000","last_clean":"2021-08-21T15:02:57.838109+0000","last_became_active":"2021-08-21T15:03:09.486187+0000","last_became_peered":"2021-08-21T15:03:09.486187+0000","last_unstale":"2021-08-21T15:03:30.724156+0000","last_undegraded":"2021-08-21T15:03:09.473203+0000","last_fullsized":"2021-08-21T15:03:09.458334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3669,"ondisk_log_size":3669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":60,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3669,"num_write_kb":14676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1015808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3609}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"19'3561","reported_seq":3592,"reported_epoch":25,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:03:29.565279+0000","last_change":"2021-08-21T15:03:09.497229+0000","last_active":"2021-08-21T15:03:29.565279+0000","last_peered":"2021-08-21T15:03:29.565279+0000","last_clean":"2021-08-21T15:03:05.635315+0000","last_became_active":"2021-08-21T15:03:09.493570+0000","last_became_peered":"2021-08-21T15:03:09.493570+0000","last_unstale":"2021-08-21T15:03:29.565279+0000","last_undegraded":"2021-08-21T15:03:09.473758+0000","last_fullsized":"2021-08-21T15:03:09.458745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3561,"ondisk_log_size":3561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":286,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3561,"num_write_kb":14244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3275}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"19'3153","reported_seq":3180,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2021-08-21T15:03:30.566608+0000","last_change":"2021-08-21T15:03:30.564744+0000","last_active":"2021-08-21T15:03:30.566608+0000","last_peered":"2021-08-21T15:03:30.566608+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:03:30.564744+0000","last_became_peered":"2021-08-21T15:03:30.564744+0000","last_unstale":"2021-08-21T15:03:30.566608+0000","last_undegraded":"2021-08-21T15:03:30.563510+0000","last_fullsized":"2021-08-21T15:03:30.563438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3153,"ondisk_log_size":3153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3153,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"24'3566","reported_seq":3595,"reported_epoch":25,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:03:29.565274+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:03:29.565274+0000","last_peered":"2021-08-21T15:03:29.565274+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:03:29.565274+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3566,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3566,"num_write_kb":14264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"26'3569","reported_seq":3590,"reported_epoch":26,"state":"active+undersized+degraded","last_fresh":"2021-08-21T15:03:30.568342+0000","last_change":"2021-08-21T15:03:30.565579+0000","last_active":"2021-08-21T15:03:30.568342+0000","last_peered":"2021-08-21T15:03:30.568342+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:03:30.565579+0000","last_became_peered":"2021-08-21T15:03:30.565579+0000","last_unstale":"2021-08-21T15:03:30.568342+0000","last_undegraded":"2021-08-21T15:03:30.564055+0000","last_fullsized":"2021-08-21T15:03:30.563976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":3569,"ondisk_log_size":3569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614552,"num_objects":3569,"num_object_clones":0,"num_object_copies":7138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3569,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3569,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3569,"num_write_kb":14273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3569}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143256,"num_objects":27868,"num_object_clones":0,"num_object_copies":55736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14572,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27868,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27868,"num_write_kb":111469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1015808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":225832960,"data_stored":225828888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27868,"ondisk_log_size":27868,"up":12,"acting":8,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738380,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86012,"kb_used_data":54836,"kb_used_omap":0,"kb_used_meta":31168,"kb_avail":94285828,"statfs":{"total":96636764160,"available":96548687872,"internally_reserved":0,"allocated":56152064,"data_stored":56034166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31916032},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.151}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124628,"kb_used_data":85644,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":94247212,"statfs":{"total":96636764160,"available":96509145088,"internally_reserved":0,"allocated":87699456,"data_stored":87550663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280519,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111880,"kb_used_data":79424,"kb_used_omap":1,"kb_used_meta":32446,"kb_avail":94259960,"statfs":{"total":96636764160,"available":96522199040,"internally_reserved":0,"allocated":81330176,"data_stored":81176049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":33225672},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,6],"upper_bound":65536},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87490560,"data_stored":87486488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81125376,"data_stored":81125376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57217024,"data_stored":57217024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:03:33.513 INFO:tasks.osd_recovery.ceph_manager:active or down! 2021-08-21T15:03:33.513 INFO:tasks.osd_recovery:rados -p rbd bench 15 write -b 4096 2021-08-21T15:03:33.513 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rbd bench 15 write -b 4096 2021-08-21T15:03:33.559 INFO:teuthology.orchestra.run.smithi173.stdout:hints = 1 2021-08-21T15:03:33.559 INFO:teuthology.orchestra.run.smithi173.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 15 seconds or 0 objects 2021-08-21T15:03:33.560 INFO:teuthology.orchestra.run.smithi173.stdout:Object prefix: benchmark_data_smithi173_37458 2021-08-21T15:03:33.560 INFO:teuthology.orchestra.run.smithi173.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-08-21T15:03:33.560 INFO:teuthology.orchestra.run.smithi173.stdout: 0 0 0 0 0 0 - 0 2021-08-21T15:03:33.639 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:33.635+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x564dd025dc10 msgr2=0x564dd0260000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-21T15:03:33.654 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:33.652+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x7f9294035f10 msgr2=0x7f9294038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-21T15:03:34.556 INFO:teuthology.orchestra.run.smithi173.stdout: 1 16 1355 1339 5.22546 5.23047 0.00899841 0.0118978 2021-08-21T15:03:35.556 INFO:teuthology.orchestra.run.smithi173.stdout: 2 16 2665 2649 5.17114 5.11719 0.00747013 0.0120341 2021-08-21T15:03:36.190 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:36.181+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x7f9294035f10 msgr2=0x7f9294038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:03:36.213 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:36.204+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x564dd02635f0 msgr2=0x7f9294039940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:03:36.223 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:36.219+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x7f9294035f10 msgr2=0x7f9294038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:03:36.489 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:36.488+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x7f9294035f10 msgr2=0x7f9294038300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2021-08-21T15:03:36.558 INFO:teuthology.orchestra.run.smithi173.stdout: 3 16 3969 3953 5.14523 5.09375 0.0170992 0.0121167 2021-08-21T15:03:37.558 INFO:teuthology.orchestra.run.smithi173.stdout: 4 16 4135 4119 4.02124 0.648438 0.00299293 0.0120403 2021-08-21T15:03:38.557 INFO:teuthology.orchestra.run.smithi173.stdout: 5 16 4135 4119 3.21714 0 - 0.0120403 2021-08-21T15:03:39.558 INFO:teuthology.orchestra.run.smithi173.stdout: 6 16 4135 4119 2.68102 0 - 0.0120403 2021-08-21T15:03:40.556 INFO:teuthology.orchestra.run.smithi173.stdout: 7 16 4135 4119 2.29807 0 - 0.0120403 2021-08-21T15:03:41.556 INFO:teuthology.orchestra.run.smithi173.stdout: 8 16 4135 4119 2.01084 0 - 0.0120403 2021-08-21T15:03:42.556 INFO:teuthology.orchestra.run.smithi173.stdout: 9 16 4135 4119 1.78743 0 - 0.0120403 2021-08-21T15:03:43.556 INFO:teuthology.orchestra.run.smithi173.stdout: 10 16 4135 4119 1.6087 0 - 0.0120403 2021-08-21T15:03:44.559 INFO:teuthology.orchestra.run.smithi173.stdout: 11 16 4135 4119 1.46246 0 - 0.0120403 2021-08-21T15:03:45.559 INFO:teuthology.orchestra.run.smithi173.stdout: 12 16 4135 4119 1.3406 0 - 0.0120403 2021-08-21T15:03:46.557 INFO:teuthology.orchestra.run.smithi173.stdout: 13 16 4135 4119 1.23748 0 - 0.0120403 2021-08-21T15:03:47.557 INFO:teuthology.orchestra.run.smithi173.stdout: 14 16 4135 4119 1.1491 0 - 0.0120403 2021-08-21T15:03:48.557 INFO:teuthology.orchestra.run.smithi173.stdout: 15 16 4135 4119 1.0725 0 - 0.0120403 2021-08-21T15:03:49.557 INFO:teuthology.orchestra.run.smithi173.stdout:Total time run: 15.9642 2021-08-21T15:03:49.558 INFO:teuthology.orchestra.run.smithi173.stdout:Total writes made: 4135 2021-08-21T15:03:49.558 INFO:teuthology.orchestra.run.smithi173.stdout:Write size: 4096 2021-08-21T15:03:49.558 INFO:teuthology.orchestra.run.smithi173.stdout:Object size: 4096 2021-08-21T15:03:49.559 INFO:teuthology.orchestra.run.smithi173.stdout:Bandwidth (MB/sec): 1.01178 2021-08-21T15:03:49.559 INFO:teuthology.orchestra.run.smithi173.stdout:Stddev Bandwidth: 2.11544 2021-08-21T15:03:49.559 INFO:teuthology.orchestra.run.smithi173.stdout:Max bandwidth (MB/sec): 5.23047 2021-08-21T15:03:49.559 INFO:teuthology.orchestra.run.smithi173.stdout:Min bandwidth (MB/sec): 0 2021-08-21T15:03:49.559 INFO:teuthology.orchestra.run.smithi173.stdout:Average IOPS: 259 2021-08-21T15:03:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:Stddev IOPS: 541.553 2021-08-21T15:03:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:Max IOPS: 1339 2021-08-21T15:03:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:Min IOPS: 0 2021-08-21T15:03:49.561 INFO:teuthology.orchestra.run.smithi173.stdout:Average Latency(s): 0.0617652 2021-08-21T15:03:49.561 INFO:teuthology.orchestra.run.smithi173.stdout:Stddev Latency(s): 0.797944 2021-08-21T15:03:49.561 INFO:teuthology.orchestra.run.smithi173.stdout:Max latency(s): 12.9131 2021-08-21T15:03:49.561 INFO:teuthology.orchestra.run.smithi173.stdout:Min latency(s): 0.00127542 2021-08-21T15:03:49.562 INFO:teuthology.orchestra.run.smithi173.stdout:Cleaning up (deleting benchmark objects) 2021-08-21T15:03:50.810 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:50.807+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x564dd02635f0 msgr2=0x7f9294039940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:03:52.057 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:52.055+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x564dd02635f0 msgr2=0x7f9294039940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:03:52.411 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:03:52.409+0000 7f92af41e700 0 -- 172.21.15.173:0/2971235967 >> [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] conn(0x564dd025dc10 msgr2=0x7f929403ac80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2021-08-21T15:03:52.540 INFO:teuthology.orchestra.run.smithi173.stdout:Removed 4135 objects 2021-08-21T15:03:52.540 INFO:teuthology.orchestra.run.smithi173.stdout:Clean up completed and total clean up time :2.97928 2021-08-21T15:03:52.547 INFO:tasks.ceph.osd.2:Restarting daemon 2021-08-21T15:03:52.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-08-21T15:03:52.589 INFO:tasks.ceph.osd.2:Started 2021-08-21T15:03:52.590 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2021-08-21T15:03:52.707 INFO:teuthology.orchestra.run.smithi173.stderr:no valid command found; 10 closest matches: 2021-08-21T15:03:52.708 INFO:teuthology.orchestra.run.smithi173.stderr:0 2021-08-21T15:03:52.709 INFO:teuthology.orchestra.run.smithi173.stderr:1 2021-08-21T15:03:52.709 INFO:teuthology.orchestra.run.smithi173.stderr:2 2021-08-21T15:03:52.710 INFO:teuthology.orchestra.run.smithi173.stderr:abort 2021-08-21T15:03:52.710 INFO:teuthology.orchestra.run.smithi173.stderr:assert 2021-08-21T15:03:52.710 INFO:teuthology.orchestra.run.smithi173.stderr:config diff 2021-08-21T15:03:52.710 INFO:teuthology.orchestra.run.smithi173.stderr:config diff get 2021-08-21T15:03:52.711 INFO:teuthology.orchestra.run.smithi173.stderr:config get 2021-08-21T15:03:52.711 INFO:teuthology.orchestra.run.smithi173.stderr:config help [] 2021-08-21T15:03:52.711 INFO:teuthology.orchestra.run.smithi173.stderr:config set ... 2021-08-21T15:03:52.711 INFO:teuthology.orchestra.run.smithi173.stderr:admin_socket: invalid command 2021-08-21T15:03:52.712 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-08-21T15:03:52.713 INFO:tasks.osd_recovery.ceph_manager:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2021-08-21T15:03:53.173 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:03:53.171+0000 7f5c697660c0 -1 Falling back to public interface 2021-08-21T15:03:55.808 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:03:55.803+0000 7f5c697660c0 -1 bluestore::NCB::restore_allocator::No Valid allocation info on disk (empty file) 2021-08-21T15:03:57.056 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:03:57.056+0000 7f5c697660c0 -1 bluestore::NCB::restore_allocator::No Valid allocation info on disk (empty file) 2021-08-21T15:03:57.715 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2021-08-21T15:03:57.832 INFO:teuthology.orchestra.run.smithi173.stderr:no valid command found; 10 closest matches: 2021-08-21T15:03:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:0 2021-08-21T15:03:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:1 2021-08-21T15:03:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2 2021-08-21T15:03:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:abort 2021-08-21T15:03:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:assert 2021-08-21T15:03:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs debug_inject_read_zeros 2021-08-21T15:03:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs files list 2021-08-21T15:03:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:bluefs stats 2021-08-21T15:03:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:bluestore allocator dump block 2021-08-21T15:03:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:bluestore allocator fragmentation block 2021-08-21T15:03:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:admin_socket: invalid command 2021-08-21T15:03:57.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-08-21T15:03:57.837 INFO:tasks.osd_recovery.ceph_manager:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2021-08-21T15:03:58.038 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:03:58.037+0000 7f5c697660c0 -1 osd.2 19 log_to_monitors {default=true} 2021-08-21T15:03:58.662 INFO:tasks.ceph.osd.2.smithi173.stderr:2021-08-21T15:03:58.662+0000 7f5c58ab7700 -1 osd.2 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-08-21T15:04:02.838 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2021-08-21T15:04:02.971 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2021-08-21T15:04:02.971 INFO:teuthology.orchestra.run.smithi173.stdout: "ops": [], 2021-08-21T15:04:02.972 INFO:teuthology.orchestra.run.smithi173.stdout: "num_ops": 0 2021-08-21T15:04:02.972 INFO:teuthology.orchestra.run.smithi173.stdout:} 2021-08-21T15:04:02.984 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2021-08-21T15:04:03.289 INFO:teuthology.orchestra.run.smithi173.stdout:epoch 32 2021-08-21T15:04:03.290 INFO:teuthology.orchestra.run.smithi173.stdout:fsid 90c992ca-066c-4cb6-b72f-9d34f4a3b9cc 2021-08-21T15:04:03.290 INFO:teuthology.orchestra.run.smithi173.stdout:created 2021-08-21T15:02:13.689963+0000 2021-08-21T15:04:03.291 INFO:teuthology.orchestra.run.smithi173.stdout:modified 2021-08-21T15:04:01.645031+0000 2021-08-21T15:04:03.292 INFO:teuthology.orchestra.run.smithi173.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2021-08-21T15:04:03.294 INFO:teuthology.orchestra.run.smithi173.stdout:crush_version 6 2021-08-21T15:04:03.294 INFO:teuthology.orchestra.run.smithi173.stdout:full_ratio 0.95 2021-08-21T15:04:03.295 INFO:teuthology.orchestra.run.smithi173.stdout:backfillfull_ratio 0.9 2021-08-21T15:04:03.296 INFO:teuthology.orchestra.run.smithi173.stdout:nearfull_ratio 0.85 2021-08-21T15:04:03.296 INFO:teuthology.orchestra.run.smithi173.stdout:require_min_compat_client luminous 2021-08-21T15:04:03.296 INFO:teuthology.orchestra.run.smithi173.stdout:min_compat_client jewel 2021-08-21T15:04:03.296 INFO:teuthology.orchestra.run.smithi173.stdout:require_osd_release quincy 2021-08-21T15:04:03.297 INFO:teuthology.orchestra.run.smithi173.stdout:stretch_mode_enabled false 2021-08-21T15:04:03.297 INFO:teuthology.orchestra.run.smithi173.stdout:pool 1 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd 2021-08-21T15:04:03.297 INFO:teuthology.orchestra.run.smithi173.stdout:max_osd 3 2021-08-21T15:04:03.298 INFO:teuthology.orchestra.run.smithi173.stdout:osd.0 up in weight 1 up_from 8 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] [v2:172.21.15.173:6802/31933,v1:172.21.15.173:6803/31933] exists,up c451cd41-e092-4d5b-8814-3fed7d05d1b1 2021-08-21T15:04:03.298 INFO:teuthology.orchestra.run.smithi173.stdout:osd.1 up in weight 1 up_from 22 up_thru 31 down_at 21 last_clean_interval [8,19) [v2:172.21.15.173:6806/36292,v1:172.21.15.173:6808/36292] [v2:172.21.15.173:6810/36292,v1:172.21.15.173:6811/36292] exists,up 3be64b81-b923-4725-a4aa-e3881c179bc9 2021-08-21T15:04:03.298 INFO:teuthology.orchestra.run.smithi173.stdout:osd.2 up in weight 1 up_from 30 up_thru 30 down_at 25 last_clean_interval [8,19) [v2:172.21.15.173:6816/37540,v1:172.21.15.173:6817/37540] [v2:172.21.15.173:6818/37540,v1:172.21.15.173:6819/37540] exists,up 2f78db3f-b431-434d-80ac-2de5ec7ac4f8 2021-08-21T15:04:03.298 INFO:teuthology.orchestra.run.smithi173.stdout:pg_temp 1.1 [0] 2021-08-21T15:04:03.299 INFO:teuthology.orchestra.run.smithi173.stdout:pg_temp 1.3 [1] 2021-08-21T15:04:03.299 INFO:teuthology.orchestra.run.smithi173.stdout:pg_temp 1.4 [0] 2021-08-21T15:04:03.299 INFO:teuthology.orchestra.run.smithi173.stdout:pg_temp 1.5 [0] 2021-08-21T15:04:03.300 INFO:teuthology.orchestra.run.smithi173.stdout:pg_temp 1.6 [0] 2021-08-21T15:04:03.300 INFO:teuthology.orchestra.run.smithi173.stdout:pg_temp 1.7 [1] 2021-08-21T15:04:03.307 INFO:tasks.osd_recovery.ceph_manager:['osd.0 up in weight 1 up_from 8 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/31933,v1:172.21.15.173:6801/31933] [v2:172.21.15.173:6802/31933,v1:172.21.15.173:6803/31933] exists,up c451cd41-e092-4d5b-8814-3fed7d05d1b1', 'osd.1 up in weight 1 up_from 22 up_thru 31 down_at 21 last_clean_interval [8,19) [v2:172.21.15.173:6806/36292,v1:172.21.15.173:6808/36292] [v2:172.21.15.173:6810/36292,v1:172.21.15.173:6811/36292] exists,up 3be64b81-b923-4725-a4aa-e3881c179bc9', 'osd.2 up in weight 1 up_from 30 up_thru 30 down_at 25 last_clean_interval [8,19) [v2:172.21.15.173:6816/37540,v1:172.21.15.173:6817/37540] [v2:172.21.15.173:6818/37540,v1:172.21.15.173:6819/37540] exists,up 2f78db3f-b431-434d-80ac-2de5ec7ac4f8'] 2021-08-21T15:04:03.308 INFO:tasks.osd_recovery:3 are up! 2021-08-21T15:04:03.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-08-21T15:04:03.455 INFO:teuthology.orchestra.run.smithi173.stdout:34359738393 2021-08-21T15:04:03.456 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-08-21T15:04:03.605 INFO:teuthology.orchestra.run.smithi173.stdout:94489280526 2021-08-21T15:04:03.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-08-21T15:04:03.759 INFO:teuthology.orchestra.run.smithi173.stdout:128849018883 2021-08-21T15:04:03.762 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-08-21T15:04:04.049 INFO:teuthology.orchestra.run.smithi173.stdout:34359738391 2021-08-21T15:04:04.062 INFO:tasks.osd_recovery.ceph_manager:need seq 34359738393 got 34359738391 for osd.0 2021-08-21T15:04:05.064 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-08-21T15:04:05.369 INFO:teuthology.orchestra.run.smithi173.stdout:34359738393 2021-08-21T15:04:05.465 INFO:tasks.osd_recovery.ceph_manager:need seq 34359738393 got 34359738393 for osd.0 2021-08-21T15:04:05.466 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-08-21T15:04:05.782 INFO:teuthology.orchestra.run.smithi173.stdout:94489280526 2021-08-21T15:04:05.796 INFO:tasks.osd_recovery.ceph_manager:need seq 94489280526 got 94489280526 for osd.1 2021-08-21T15:04:05.797 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-08-21T15:04:06.094 INFO:teuthology.orchestra.run.smithi173.stdout:128849018883 2021-08-21T15:04:06.108 INFO:tasks.osd_recovery.ceph_manager:need seq 128849018883 got 128849018883 for osd.2 2021-08-21T15:04:06.108 INFO:tasks.osd_recovery.ceph_manager:waiting for clean 2021-08-21T15:04:06.109 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:06.399 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:06.401 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:06.412 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2021-08-21T15:04:06.339596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":671,"num_bytes_recovered":2596864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333508,"kb_used_data":221420,"kb_used_omap":2,"kb_used_meta":112061,"kb_avail":282782012,"statfs":{"total":289910292480,"available":289568780288,"internally_reserved":0,"allocated":226734080,"data_stored":226179308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":114751376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-12104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":307200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.689786"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4395,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:05.631234+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:05.631234+0000","last_peered":"2021-08-21T15:04:05.631234+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:05.631234+0000","last_undegraded":"2021-08-21T15:04:05.631234+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4595,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:03.382802+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:03.382802+0000","last_peered":"2021-08-21T15:04:03.382802+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:03.382802+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":139264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3198}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":671,"num_bytes_recovered":2596864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":225972224,"data_stored":225972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83920,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29246,"kb_avail":94287920,"statfs":{"total":96636764160,"available":96550830080,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":29948872},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280527,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117480,"kb_used_data":81056,"kb_used_omap":1,"kb_used_meta":36414,"kb_avail":94254360,"statfs":{"total":96636764160,"available":96516464640,"internally_reserved":0,"allocated":83001344,"data_stored":82816420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37288904},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82780160,"data_stored":82780160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:06.414 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:06.704 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:06.706 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:06.716 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2021-08-21T15:04:06.339596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":671,"num_bytes_recovered":2596864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333508,"kb_used_data":221420,"kb_used_omap":2,"kb_used_meta":112061,"kb_avail":282782012,"statfs":{"total":289910292480,"available":289568780288,"internally_reserved":0,"allocated":226734080,"data_stored":226179308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":114751376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-12104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":307200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.689786"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4395,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:05.631234+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:05.631234+0000","last_peered":"2021-08-21T15:04:05.631234+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:05.631234+0000","last_undegraded":"2021-08-21T15:04:05.631234+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4595,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:03.382802+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:03.382802+0000","last_peered":"2021-08-21T15:04:03.382802+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:03.382802+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":139264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3198}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":671,"num_bytes_recovered":2596864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":225972224,"data_stored":225972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83920,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29246,"kb_avail":94287920,"statfs":{"total":96636764160,"available":96550830080,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":29948872},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280527,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117480,"kb_used_data":81056,"kb_used_omap":1,"kb_used_meta":36414,"kb_avail":94254360,"statfs":{"total":96636764160,"available":96516464640,"internally_reserved":0,"allocated":83001344,"data_stored":82816420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37288904},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82780160,"data_stored":82780160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:06.718 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:07.075 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:07.075 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2156/55734 objects degraded (3.868%), 5 pgs degraded","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":113,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":341512192,"bytes_avail":289568780288,"bytes_total":289910292480,"degraded_objects":2156,"degraded_total":55734,"degraded_ratio":0.038683747802059784,"recovering_objects_per_sec":16,"recovering_bytes_per_sec":45920,"recovering_keys_per_sec":0,"num_objects_recovered":112,"num_bytes_recovered":307200,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:07.086 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:07.087 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:07.407 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:07.408 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:07.414 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2021-08-21T15:04:06.339596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":671,"num_bytes_recovered":2596864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333508,"kb_used_data":221420,"kb_used_omap":2,"kb_used_meta":112061,"kb_avail":282782012,"statfs":{"total":289910292480,"available":289568780288,"internally_reserved":0,"allocated":226734080,"data_stored":226179308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":114751376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-12104,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":307200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.689786"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4395,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:05.631234+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:05.631234+0000","last_peered":"2021-08-21T15:04:05.631234+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:05.631234+0000","last_undegraded":"2021-08-21T15:04:05.631234+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4595,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:03.382802+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:03.382802+0000","last_peered":"2021-08-21T15:04:03.382802+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:03.382802+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":273,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":139264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3198}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2156,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":671,"num_bytes_recovered":2596864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":225972224,"data_stored":225972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018883,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83920,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29246,"kb_avail":94287920,"statfs":{"total":96636764160,"available":96550830080,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":29948872},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280527,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117480,"kb_used_data":81056,"kb_used_omap":1,"kb_used_meta":36414,"kb_avail":94254360,"statfs":{"total":96636764160,"available":96516464640,"internally_reserved":0,"allocated":83001344,"data_stored":82816420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37288904},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82780160,"data_stored":82780160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:10.416 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:10.703 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:10.705 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:10.716 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2021-08-21T15:04:10.340274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2109,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":718,"num_bytes_recovered":2789376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333572,"kb_used_data":221420,"kb_used_omap":2,"kb_used_meta":112125,"kb_avail":282781948,"statfs":{"total":289910292480,"available":289568714752,"internally_reserved":0,"allocated":226734080,"data_stored":226179308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":114816912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-12151,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":499712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.692246"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4395,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:05.631234+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:05.631234+0000","last_peered":"2021-08-21T15:04:05.631234+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:05.631234+0000","last_undegraded":"2021-08-21T15:04:05.631234+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4689,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:07.421642+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:07.421642+0000","last_peered":"2021-08-21T15:04:07.421642+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:07.421642+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":226,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":331776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3245}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2109,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":718,"num_bytes_recovered":2789376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":225972224,"data_stored":225972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83984,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29310,"kb_avail":94287856,"statfs":{"total":96636764160,"available":96550764544,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30014408},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738394,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280527,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117480,"kb_used_data":81056,"kb_used_omap":1,"kb_used_meta":36414,"kb_avail":94254360,"statfs":{"total":96636764160,"available":96516464640,"internally_reserved":0,"allocated":83001344,"data_stored":82816420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37288904},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82780160,"data_stored":82780160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:10.717 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:11.071 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:11.072 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2109/55734 objects degraded (3.784%), 5 pgs degraded, 2 pgs undersized","count":7},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":117,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":341577728,"bytes_avail":289568714752,"bytes_total":289910292480,"degraded_objects":2109,"degraded_total":55734,"degraded_ratio":0.037840456453870172,"recovering_objects_per_sec":16,"recovering_bytes_per_sec":51557,"recovering_keys_per_sec":0,"num_objects_recovered":159,"num_bytes_recovered":499712,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:11.083 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:11.083 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:11.415 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:11.418 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:11.429 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2021-08-21T15:04:10.340274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2109,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":718,"num_bytes_recovered":2789376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333572,"kb_used_data":221420,"kb_used_omap":2,"kb_used_meta":112125,"kb_avail":282781948,"statfs":{"total":289910292480,"available":289568714752,"internally_reserved":0,"allocated":226734080,"data_stored":226179308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":114816912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-12151,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":499712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.692246"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4395,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:05.631234+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:05.631234+0000","last_peered":"2021-08-21T15:04:05.631234+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:05.631234+0000","last_undegraded":"2021-08-21T15:04:05.631234+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4689,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:07.421642+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:07.421642+0000","last_peered":"2021-08-21T15:04:07.421642+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:07.421642+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":226,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":331776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3245}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2109,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":718,"num_bytes_recovered":2789376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":225972224,"data_stored":225972224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83984,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29310,"kb_avail":94287856,"statfs":{"total":96636764160,"available":96550764544,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30014408},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738394,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280527,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117480,"kb_used_data":81056,"kb_used_omap":1,"kb_used_meta":36414,"kb_avail":94254360,"statfs":{"total":96636764160,"available":96516464640,"internally_reserved":0,"allocated":83001344,"data_stored":82816420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37288904},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82780160,"data_stored":82780160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:14.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:14.720 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:14.721 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:14.734 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2021-08-21T15:04:14.340998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2051,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":834,"num_bytes_recovered":3026944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334044,"kb_used_data":221700,"kb_used_omap":2,"kb_used_meta":112317,"kb_avail":282781476,"statfs":{"total":289910292480,"available":289568231424,"internally_reserved":0,"allocated":227020800,"data_stored":226466028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":115013520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-5701,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":737280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002109"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4511,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:10.616967+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:10.616967+0000","last_peered":"2021-08-21T15:04:10.616967+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:10.616967+0000","last_undegraded":"2021-08-21T15:04:10.616967+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4805,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:12.405507+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:12.405507+0000","last_peered":"2021-08-21T15:04:12.405507+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:12.405507+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":569344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3303}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2051,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":834,"num_bytes_recovered":3026944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226209792,"data_stored":226209792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84048,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94287792,"statfs":{"total":96636764160,"available":96550699008,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738395,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.19},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280528,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117888,"kb_used_data":81336,"kb_used_omap":1,"kb_used_meta":36542,"kb_avail":94253952,"statfs":{"total":96636764160,"available":96516046848,"internally_reserved":0,"allocated":83288064,"data_stored":83103140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37419976},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83017728,"data_stored":83017728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:14.735 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:15.119 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:15.119 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2051/55734 objects degraded (3.680%), 5 pgs degraded, 2 pgs undersized","count":7},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":121,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342061056,"bytes_avail":289568231424,"bytes_total":289910292480,"degraded_objects":2051,"degraded_total":55734,"degraded_ratio":0.036799799045465965,"recovering_objects_per_sec":22,"recovering_bytes_per_sec":61429,"recovering_keys_per_sec":0,"num_objects_recovered":275,"num_bytes_recovered":737280,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:15.120 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:15.120 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:15.426 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:15.427 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:15.441 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2021-08-21T15:04:14.340998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2051,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":834,"num_bytes_recovered":3026944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334044,"kb_used_data":221700,"kb_used_omap":2,"kb_used_meta":112317,"kb_avail":282781476,"statfs":{"total":289910292480,"available":289568231424,"internally_reserved":0,"allocated":227020800,"data_stored":226466028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":115013520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-5701,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":737280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002109"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4511,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:10.616967+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:10.616967+0000","last_peered":"2021-08-21T15:04:10.616967+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:10.616967+0000","last_undegraded":"2021-08-21T15:04:10.616967+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4805,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:12.405507+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:12.405507+0000","last_peered":"2021-08-21T15:04:12.405507+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:12.405507+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":569344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3303}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2051,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":834,"num_bytes_recovered":3026944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226209792,"data_stored":226209792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84048,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94287792,"statfs":{"total":96636764160,"available":96550699008,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738395,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.19},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280528,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117888,"kb_used_data":81336,"kb_used_omap":1,"kb_used_meta":36542,"kb_avail":94253952,"statfs":{"total":96636764160,"available":96516046848,"internally_reserved":0,"allocated":83288064,"data_stored":83103140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37419976},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83017728,"data_stored":83017728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:18.444 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:18.741 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:18.742 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:18.752 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2021-08-21T15:04:18.341665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1993,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":950,"num_bytes_recovered":3264512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334296,"kb_used_data":221888,"kb_used_omap":2,"kb_used_meta":112381,"kb_avail":282781224,"statfs":{"total":289910292480,"available":289567973376,"internally_reserved":0,"allocated":227213312,"data_stored":226658540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":115079056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-163,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":667648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002069"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4627,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:15.600263+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:15.600263+0000","last_peered":"2021-08-21T15:04:15.600263+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:15.600263+0000","last_undegraded":"2021-08-21T15:04:15.600263+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4921,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:17.389995+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:17.389995+0000","last_peered":"2021-08-21T15:04:17.389995+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:17.389995+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":110,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":806912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3361}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1993,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":950,"num_bytes_recovered":3264512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226447360,"data_stored":226447360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84048,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94287792,"statfs":{"total":96636764160,"available":96550699008,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.189},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.22500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]}]},{"osd":1,"up_from":22,"seq":94489280529,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118140,"kb_used_data":81524,"kb_used_omap":1,"kb_used_meta":36606,"kb_avail":94253700,"statfs":{"total":96636764160,"available":96515788800,"internally_reserved":0,"allocated":83480576,"data_stored":83295652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37485512},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83255296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:18.753 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:19.106 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:19.107 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1993/55734 objects degraded (3.576%), 5 pgs degraded, 2 pgs undersized","count":7},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":125,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342319104,"bytes_avail":289567973376,"bytes_total":289910292480,"degraded_objects":1993,"degraded_total":55734,"degraded_ratio":0.035759141637061759,"recovering_objects_per_sec":23,"recovering_bytes_per_sec":55627,"recovering_keys_per_sec":0,"num_objects_recovered":279,"num_bytes_recovered":667648,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:19.120 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:19.120 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:19.440 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:19.441 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:19.453 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2021-08-21T15:04:18.341665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1993,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":950,"num_bytes_recovered":3264512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334296,"kb_used_data":221888,"kb_used_omap":2,"kb_used_meta":112381,"kb_avail":282781224,"statfs":{"total":289910292480,"available":289567973376,"internally_reserved":0,"allocated":227213312,"data_stored":226658540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":115079056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-163,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":667648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002069"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4627,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:15.600263+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:15.600263+0000","last_peered":"2021-08-21T15:04:15.600263+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:15.600263+0000","last_undegraded":"2021-08-21T15:04:15.600263+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4921,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:17.389995+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:17.389995+0000","last_peered":"2021-08-21T15:04:17.389995+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:17.389995+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":110,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":806912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3361}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1993,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":950,"num_bytes_recovered":3264512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226447360,"data_stored":226447360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84048,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94287792,"statfs":{"total":96636764160,"available":96550699008,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.189},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.22500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]}]},{"osd":1,"up_from":22,"seq":94489280529,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118140,"kb_used_data":81524,"kb_used_omap":1,"kb_used_meta":36606,"kb_avail":94253700,"statfs":{"total":96636764160,"available":96515788800,"internally_reserved":0,"allocated":83480576,"data_stored":83295652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37485512},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83255296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:22.454 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:22.746 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:22.748 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:22.759 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2021-08-21T15:04:22.342341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1993,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1008,"num_bytes_recovered":3264512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334760,"kb_used_data":222160,"kb_used_omap":2,"kb_used_meta":112573,"kb_avail":282780760,"statfs":{"total":289910292480,"available":289567498240,"internally_reserved":0,"allocated":227491840,"data_stored":226937068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":115275664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":475136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002067"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4743,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:20.583839+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:20.583839+0000","last_peered":"2021-08-21T15:04:20.583839+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:20.583839+0000","last_undegraded":"2021-08-21T15:04:20.583839+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4921,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:17.389995+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:17.389995+0000","last_peered":"2021-08-21T15:04:17.389995+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:17.389995+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":110,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":806912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3361}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1993,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1008,"num_bytes_recovered":3264512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226689024,"data_stored":226689024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018886,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84112,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29438,"kb_avail":94287728,"statfs":{"total":96636764160,"available":96550633472,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30145480},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.189},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.22500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]}]},{"osd":1,"up_from":22,"seq":94489280530,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118540,"kb_used_data":81796,"kb_used_omap":1,"kb_used_meta":36734,"kb_avail":94253300,"statfs":{"total":96636764160,"available":96515379200,"internally_reserved":0,"allocated":83759104,"data_stored":83574180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37616584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.189}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83496960,"data_stored":83496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:22.761 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:23.110 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:23.110 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1993/55734 objects degraded (3.576%), 5 pgs degraded, 2 pgs undersized","count":7},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":129,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342794240,"bytes_avail":289567498240,"bytes_total":289910292480,"degraded_objects":1993,"degraded_total":55734,"degraded_ratio":0.035759141637061759,"recovering_objects_per_sec":24,"recovering_bytes_per_sec":39587,"recovering_keys_per_sec":0,"num_objects_recovered":290,"num_bytes_recovered":475136,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:23.123 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:23.124 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:23.423 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:23.424 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:23.435 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2021-08-21T15:04:22.342341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1993,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1008,"num_bytes_recovered":3264512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334760,"kb_used_data":222160,"kb_used_omap":2,"kb_used_meta":112573,"kb_avail":282780760,"statfs":{"total":289910292480,"available":289567498240,"internally_reserved":0,"allocated":227491840,"data_stored":226937068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":115275664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":475136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002067"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4743,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:20.583839+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:20.583839+0000","last_peered":"2021-08-21T15:04:20.583839+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:20.583839+0000","last_undegraded":"2021-08-21T15:04:20.583839+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":217,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4921,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:17.389995+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:17.389995+0000","last_peered":"2021-08-21T15:04:17.389995+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:17.389995+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":110,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":806912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3361}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1993,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1008,"num_bytes_recovered":3264512,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226689024,"data_stored":226689024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018886,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84112,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29438,"kb_avail":94287728,"statfs":{"total":96636764160,"available":96550633472,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30145480},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.189},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.22500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]}]},{"osd":1,"up_from":22,"seq":94489280530,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118540,"kb_used_data":81796,"kb_used_omap":1,"kb_used_meta":36734,"kb_avail":94253300,"statfs":{"total":96636764160,"available":96515379200,"internally_reserved":0,"allocated":83759104,"data_stored":83574180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":37616584},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.189}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83496960,"data_stored":83496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:26.438 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:26.727 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:26.728 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:26.739 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2021-08-21T15:04:26.343037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1934,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1126,"num_bytes_recovered":3506176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":339176,"kb_used_data":222352,"kb_used_omap":2,"kb_used_meta":116797,"kb_avail":282776344,"statfs":{"total":289910292480,"available":289562976256,"internally_reserved":0,"allocated":227688448,"data_stored":227133676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":119601040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-117,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":479232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002038"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4861,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:25.655786+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:25.655786+0000","last_peered":"2021-08-21T15:04:25.655786+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:25.655786+0000","last_undegraded":"2021-08-21T15:04:25.655786+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":5039,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:22.460106+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:22.460106+0000","last_peered":"2021-08-21T15:04:22.460106+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:22.460106+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":51,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3420}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1934,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1126,"num_bytes_recovered":3506176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226926592,"data_stored":226926592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84176,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29502,"kb_avail":94287664,"statfs":{"total":96636764160,"available":96550567936,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30211016},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.189}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280531,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122892,"kb_used_data":81988,"kb_used_omap":1,"kb_used_meta":40894,"kb_avail":94248948,"statfs":{"total":96636764160,"available":96510922752,"internally_reserved":0,"allocated":83955712,"data_stored":83770788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":41876424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.192}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83734528,"data_stored":83734528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:26.742 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:27.129 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:27.129 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1934/55734 objects degraded (3.470%), 5 pgs degraded, 2 pgs undersized","count":7},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":133,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":6},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":347316224,"bytes_avail":289562976256,"bytes_total":289910292480,"degraded_objects":1934,"degraded_total":55734,"degraded_ratio":0.034700541859547136,"recovering_objects_per_sec":24,"recovering_bytes_per_sec":39929,"recovering_keys_per_sec":0,"num_objects_recovered":292,"num_bytes_recovered":479232,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:27.142 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:27.143 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:27.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:27.431 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:27.441 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2021-08-21T15:04:26.343037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1934,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1126,"num_bytes_recovered":3506176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":339176,"kb_used_data":222352,"kb_used_omap":2,"kb_used_meta":116797,"kb_avail":282776344,"statfs":{"total":289910292480,"available":289562976256,"internally_reserved":0,"allocated":227688448,"data_stored":227133676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":119601040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-117,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":292,"num_bytes_recovered":479232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002038"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4861,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:25.655786+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:25.655786+0000","last_peered":"2021-08-21T15:04:25.655786+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:25.655786+0000","last_undegraded":"2021-08-21T15:04:25.655786+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":5039,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:22.460106+0000","last_change":"2021-08-21T15:04:00.543897+0000","last_active":"2021-08-21T15:04:22.460106+0000","last_peered":"2021-08-21T15:04:22.460106+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:22.460106+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":51,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":1048576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3420}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4725,"reported_epoch":31,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:00.652054+0000","last_change":"2021-08-21T15:03:09.506998+0000","last_active":"2021-08-21T15:04:00.652054+0000","last_peered":"2021-08-21T15:04:00.652054+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:00.652054+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":318,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3248}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1934,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1126,"num_bytes_recovered":3506176,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226926592,"data_stored":226926592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84176,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":29502,"kb_avail":94287664,"statfs":{"total":96636764160,"available":96550567936,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30211016},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.189}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280531,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122892,"kb_used_data":81988,"kb_used_omap":1,"kb_used_meta":40894,"kb_avail":94248948,"statfs":{"total":96636764160,"available":96510922752,"internally_reserved":0,"allocated":83955712,"data_stored":83770788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":41876424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.192}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83734528,"data_stored":83734528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:30.443 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:30.753 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:30.755 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:30.766 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2021-08-21T15:04:30.343749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1876,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1184,"num_bytes_recovered":3743744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":343336,"kb_used_data":222352,"kb_used_omap":2,"kb_used_meta":120957,"kb_avail":282772184,"statfs":{"total":289910292480,"available":289558716416,"internally_reserved":0,"allocated":227688448,"data_stored":227133676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":123860880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-117,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":479232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001407"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4861,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:25.655786+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:25.655786+0000","last_peered":"2021-08-21T15:04:25.655786+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:25.655786+0000","last_undegraded":"2021-08-21T15:04:25.655786+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":5142,"reported_epoch":32,"state":"active+undersized+remapped","last_fresh":"2021-08-21T15:04:26.843459+0000","last_change":"2021-08-21T15:04:26.926843+0000","last_active":"2021-08-21T15:04:26.843459+0000","last_peered":"2021-08-21T15:04:26.843459+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:26.843459+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0","objects":3471}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4740,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.446080+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:27.446080+0000","last_peered":"2021-08-21T15:04:27.446080+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:27.446080+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":311,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":28672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3255}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1876,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1184,"num_bytes_recovered":3743744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226926592,"data_stored":226926592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018888,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88336,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":33662,"kb_avail":94283504,"statfs":{"total":96636764160,"available":96546308096,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":34470856},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.182}]}]},{"osd":0,"up_from":8,"seq":34359738398,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.187},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.222}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280531,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122892,"kb_used_data":81988,"kb_used_omap":1,"kb_used_meta":40894,"kb_avail":94248948,"statfs":{"total":96636764160,"available":96510922752,"internally_reserved":0,"allocated":83955712,"data_stored":83770788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":41876424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.192}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83734528,"data_stored":83734528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:30.767 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:31.119 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:31.119 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1876/55734 objects degraded (3.366%), 4 pgs degraded, 2 pgs undersized","count":6},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":137,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":34,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":5},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":3},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1},{"state_name":"active+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":351576064,"bytes_avail":289558716416,"bytes_total":289910292480,"degraded_objects":1876,"degraded_total":55734,"degraded_ratio":0.03365988445114293,"recovering_objects_per_sec":21,"recovering_bytes_per_sec":59893,"recovering_keys_per_sec":0,"num_objects_recovered":176,"num_bytes_recovered":479232,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:31.132 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:31.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:31.419 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:31.420 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:31.431 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2021-08-21T15:04:30.343749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1876,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1184,"num_bytes_recovered":3743744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":343336,"kb_used_data":222352,"kb_used_omap":2,"kb_used_meta":120957,"kb_avail":282772184,"statfs":{"total":289910292480,"available":289558716416,"internally_reserved":0,"allocated":227688448,"data_stored":227133676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":123860880},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-117,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":479232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001407"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4861,"reported_epoch":32,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:25.655786+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:25.655786+0000","last_peered":"2021-08-21T15:04:25.655786+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:25.655786+0000","last_undegraded":"2021-08-21T15:04:25.655786+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":5142,"reported_epoch":32,"state":"active+undersized+remapped","last_fresh":"2021-08-21T15:04:26.843459+0000","last_change":"2021-08-21T15:04:26.926843+0000","last_active":"2021-08-21T15:04:26.843459+0000","last_peered":"2021-08-21T15:04:26.843459+0000","last_clean":"2021-08-21T15:02:57.833321+0000","last_became_active":"2021-08-21T15:03:09.490121+0000","last_became_peered":"2021-08-21T15:03:09.490121+0000","last_unstale":"2021-08-21T15:04:26.843459+0000","last_undegraded":"2021-08-21T15:03:09.473549+0000","last_fullsized":"2021-08-21T15:03:09.458434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0","objects":3471}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4571,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.008317+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:02.008317+0000","last_peered":"2021-08-21T15:04:02.008317+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:02.008317+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5404,"reported_epoch":31,"state":"active+clean","last_fresh":"2021-08-21T15:04:00.649127+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:00.649127+0000","last_peered":"2021-08-21T15:04:00.649127+0000","last_clean":"2021-08-21T15:04:00.649127+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:00.649127+0000","last_undegraded":"2021-08-21T15:04:00.649127+0000","last_fullsized":"2021-08-21T15:04:00.649127+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5188,"reported_epoch":32,"state":"active+clean","last_fresh":"2021-08-21T15:04:01.667924+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:01.667924+0000","last_peered":"2021-08-21T15:04:01.667924+0000","last_clean":"2021-08-21T15:04:01.667924+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:01.667924+0000","last_undegraded":"2021-08-21T15:04:01.667924+0000","last_fullsized":"2021-08-21T15:04:01.667924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4204,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.025063+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:02.025063+0000","last_peered":"2021-08-21T15:04:02.025063+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:02.025063+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4740,"reported_epoch":32,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.446080+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:27.446080+0000","last_peered":"2021-08-21T15:04:27.446080+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:27.446080+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":311,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":28672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3255}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4709,"reported_epoch":32,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:02.002360+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:02.002360+0000","last_peered":"2021-08-21T15:04:02.002360+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:02.002360+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1876,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1184,"num_bytes_recovered":3743744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":226926592,"data_stored":226926592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":10,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018888,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88336,"kb_used_data":54664,"kb_used_omap":1,"kb_used_meta":33662,"kb_avail":94283504,"statfs":{"total":96636764160,"available":96546308096,"internally_reserved":0,"allocated":55975936,"data_stored":55791012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":34470856},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.182}]}]},{"osd":0,"up_from":8,"seq":34359738398,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132108,"kb_used_data":85700,"kb_used_omap":0,"kb_used_meta":46400,"kb_avail":94239732,"statfs":{"total":96636764160,"available":96501485568,"internally_reserved":0,"allocated":87756800,"data_stored":87571876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47513600},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.187},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.222}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280531,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122892,"kb_used_data":81988,"kb_used_omap":1,"kb_used_meta":40894,"kb_avail":94248948,"statfs":{"total":96636764160,"available":96510922752,"internally_reserved":0,"allocated":83955712,"data_stored":83770788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":41876424},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.192}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83734528,"data_stored":83734528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:34.433 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:34.722 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:34.724 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:34.736 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2021-08-21T15:04:34.344429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1818,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1300,"num_bytes_recovered":3981312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":343920,"kb_used_data":222680,"kb_used_omap":2,"kb_used_meta":121213,"kb_avail":282771600,"statfs":{"total":289910292480,"available":289558118400,"internally_reserved":0,"allocated":228024320,"data_stored":227437709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":124123024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":475136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001392"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4979,"reported_epoch":34,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:30.638709+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:30.638709+0000","last_peered":"2021-08-21T15:04:30.638709+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:30.638709+0000","last_undegraded":"2021-08-21T15:04:30.638709+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4530,"reported_epoch":34,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:28.747975+0000","last_change":"2021-08-21T15:04:28.747975+0000","last_active":"2021-08-21T15:04:28.747975+0000","last_peered":"2021-08-21T15:04:28.747975+0000","last_clean":"2021-08-21T15:04:28.747975+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:28.747975+0000","last_undegraded":"2021-08-21T15:04:28.747975+0000","last_fullsized":"2021-08-21T15:04:28.747975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4573,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.723233+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:27.723233+0000","last_peered":"2021-08-21T15:04:27.723233+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:27.723233+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5406,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723932+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:27.723932+0000","last_peered":"2021-08-21T15:04:27.723932+0000","last_clean":"2021-08-21T15:04:27.723932+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:27.723932+0000","last_undegraded":"2021-08-21T15:04:27.723932+0000","last_fullsized":"2021-08-21T15:04:27.723932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5190,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723328+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:27.723328+0000","last_peered":"2021-08-21T15:04:27.723328+0000","last_clean":"2021-08-21T15:04:27.723328+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:27.723328+0000","last_undegraded":"2021-08-21T15:04:27.723328+0000","last_fullsized":"2021-08-21T15:04:27.723328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4206,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.724093+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:27.724093+0000","last_peered":"2021-08-21T15:04:27.724093+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:27.724093+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4858,"reported_epoch":34,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:32.429903+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:32.429903+0000","last_peered":"2021-08-21T15:04:32.429903+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:32.429903+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":253,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":266240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3313}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4711,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.723509+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:27.723509+0000","last_peered":"2021-08-21T15:04:27.723509+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:27.723509+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1818,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1300,"num_bytes_recovered":3981312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227164160,"data_stored":227164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88416,"kb_used_data":54680,"kb_used_omap":1,"kb_used_meta":33726,"kb_avail":94283424,"statfs":{"total":96636764160,"available":96546226176,"internally_reserved":0,"allocated":55992320,"data_stored":55796783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":34536392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132188,"kb_used_data":85716,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239652,"statfs":{"total":96636764160,"available":96501403648,"internally_reserved":0,"allocated":87773184,"data_stored":87577647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.21199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]}]},{"osd":1,"up_from":22,"seq":94489280532,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123316,"kb_used_data":82284,"kb_used_omap":1,"kb_used_meta":41022,"kb_avail":94248524,"statfs":{"total":96636764160,"available":96510488576,"internally_reserved":0,"allocated":84258816,"data_stored":84063279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42007496},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.187},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83972096,"data_stored":83972096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:34.738 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:35.104 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:35.104 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1818/55734 objects degraded (3.262%), 4 pgs degraded, 1 pg undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":141,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":34,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":5},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":3},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1},{"state_name":"active+clean+wait","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":352174080,"bytes_avail":289558118400,"bytes_total":289910292480,"degraded_objects":1818,"degraded_total":55734,"degraded_ratio":0.032619227042738723,"recovering_objects_per_sec":21,"recovering_bytes_per_sec":59381,"recovering_keys_per_sec":0,"num_objects_recovered":174,"num_bytes_recovered":475136,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:35.118 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:35.118 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:35.432 INFO:teuthology.orchestra.run.smithi173.stderr:2021-08-21T15:04:35.431+0000 7fa5319ea700 0 --2- 172.21.15.173:0/1090989528 >> v2:172.21.15.173:3300/0 conn(0x7fa52c116e20 0x7fa52c117200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2021-08-21T15:04:35.606 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:35.607 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:35.617 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2021-08-21T15:04:34.344429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1818,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1300,"num_bytes_recovered":3981312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":343920,"kb_used_data":222680,"kb_used_omap":2,"kb_used_meta":121213,"kb_avail":282771600,"statfs":{"total":289910292480,"available":289558118400,"internally_reserved":0,"allocated":228024320,"data_stored":227437709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":124123024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":475136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001392"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":4979,"reported_epoch":34,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:30.638709+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:30.638709+0000","last_peered":"2021-08-21T15:04:30.638709+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:30.638709+0000","last_undegraded":"2021-08-21T15:04:30.638709+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4530,"reported_epoch":34,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:28.747975+0000","last_change":"2021-08-21T15:04:28.747975+0000","last_active":"2021-08-21T15:04:28.747975+0000","last_peered":"2021-08-21T15:04:28.747975+0000","last_clean":"2021-08-21T15:04:28.747975+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:28.747975+0000","last_undegraded":"2021-08-21T15:04:28.747975+0000","last_fullsized":"2021-08-21T15:04:28.747975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4573,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.723233+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:27.723233+0000","last_peered":"2021-08-21T15:04:27.723233+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:27.723233+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5406,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723932+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:27.723932+0000","last_peered":"2021-08-21T15:04:27.723932+0000","last_clean":"2021-08-21T15:04:27.723932+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:27.723932+0000","last_undegraded":"2021-08-21T15:04:27.723932+0000","last_fullsized":"2021-08-21T15:04:27.723932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5190,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723328+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:27.723328+0000","last_peered":"2021-08-21T15:04:27.723328+0000","last_clean":"2021-08-21T15:04:27.723328+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:27.723328+0000","last_undegraded":"2021-08-21T15:04:27.723328+0000","last_fullsized":"2021-08-21T15:04:27.723328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4206,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.724093+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:27.724093+0000","last_peered":"2021-08-21T15:04:27.724093+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:27.724093+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4858,"reported_epoch":34,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:32.429903+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:32.429903+0000","last_peered":"2021-08-21T15:04:32.429903+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:32.429903+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":253,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":266240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3313}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4711,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.723509+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:27.723509+0000","last_peered":"2021-08-21T15:04:27.723509+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:27.723509+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1818,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1300,"num_bytes_recovered":3981312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227164160,"data_stored":227164160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88416,"kb_used_data":54680,"kb_used_omap":1,"kb_used_meta":33726,"kb_avail":94283424,"statfs":{"total":96636764160,"available":96546226176,"internally_reserved":0,"allocated":55992320,"data_stored":55796783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":34536392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132188,"kb_used_data":85716,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239652,"statfs":{"total":96636764160,"available":96501403648,"internally_reserved":0,"allocated":87773184,"data_stored":87577647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.21199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]}]},{"osd":1,"up_from":22,"seq":94489280532,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123316,"kb_used_data":82284,"kb_used_omap":1,"kb_used_meta":41022,"kb_avail":94248524,"statfs":{"total":96636764160,"available":96510488576,"internally_reserved":0,"allocated":84258816,"data_stored":84063279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42007496},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.187},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83972096,"data_stored":83972096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:38.619 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:38.909 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:38.918 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2021-08-21T15:04:38.345214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1760,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1416,"num_bytes_recovered":4218880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":344168,"kb_used_data":222864,"kb_used_omap":2,"kb_used_meta":121277,"kb_avail":282771352,"statfs":{"total":289910292480,"available":289557864448,"internally_reserved":0,"allocated":228212736,"data_stored":227626125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":124188560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":475136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001858"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5095,"reported_epoch":34,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:35.623081+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:35.623081+0000","last_peered":"2021-08-21T15:04:35.623081+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:35.623081+0000","last_undegraded":"2021-08-21T15:04:35.623081+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":392,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4530,"reported_epoch":34,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:28.747975+0000","last_change":"2021-08-21T15:04:28.747975+0000","last_active":"2021-08-21T15:04:28.747975+0000","last_peered":"2021-08-21T15:04:28.747975+0000","last_clean":"2021-08-21T15:04:28.747975+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:28.747975+0000","last_undegraded":"2021-08-21T15:04:28.747975+0000","last_fullsized":"2021-08-21T15:04:28.747975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4573,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.723233+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:27.723233+0000","last_peered":"2021-08-21T15:04:27.723233+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:27.723233+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5406,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723932+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:27.723932+0000","last_peered":"2021-08-21T15:04:27.723932+0000","last_clean":"2021-08-21T15:04:27.723932+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:27.723932+0000","last_undegraded":"2021-08-21T15:04:27.723932+0000","last_fullsized":"2021-08-21T15:04:27.723932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5190,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723328+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:27.723328+0000","last_peered":"2021-08-21T15:04:27.723328+0000","last_clean":"2021-08-21T15:04:27.723328+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:27.723328+0000","last_undegraded":"2021-08-21T15:04:27.723328+0000","last_fullsized":"2021-08-21T15:04:27.723328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4206,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.724093+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:27.724093+0000","last_peered":"2021-08-21T15:04:27.724093+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:27.724093+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4974,"reported_epoch":34,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:37.414873+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:37.414873+0000","last_peered":"2021-08-21T15:04:37.414873+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:37.414873+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":123,"num_bytes_recovered":503808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3371}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4711,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.723509+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:27.723509+0000","last_peered":"2021-08-21T15:04:27.723509+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:27.723509+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1760,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1416,"num_bytes_recovered":4218880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227401728,"data_stored":227401728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88416,"kb_used_data":54680,"kb_used_omap":1,"kb_used_meta":33726,"kb_avail":94283424,"statfs":{"total":96636764160,"available":96546226176,"internally_reserved":0,"allocated":55992320,"data_stored":55796783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":34536392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738400,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132188,"kb_used_data":85716,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239652,"statfs":{"total":96636764160,"available":96501403648,"internally_reserved":0,"allocated":87773184,"data_stored":87577647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.223},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280533,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123564,"kb_used_data":82468,"kb_used_omap":1,"kb_used_meta":41086,"kb_avail":94248276,"statfs":{"total":96636764160,"available":96510234624,"internally_reserved":0,"allocated":84447232,"data_stored":84251695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42073032},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.183}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84209664,"data_stored":84209664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:38.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:39.291 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:39.292 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1760/55734 objects degraded (3.158%), 4 pgs degraded, 1 pg undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":145,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":34,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":5},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":3},{"state_name":"active+clean","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1},{"state_name":"active+clean+wait","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":352428032,"bytes_avail":289557864448,"bytes_total":289910292480,"degraded_objects":1760,"degraded_total":55734,"degraded_ratio":0.031578569634334516,"recovering_objects_per_sec":23,"recovering_bytes_per_sec":47504,"recovering_keys_per_sec":0,"num_objects_recovered":232,"num_bytes_recovered":475136,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:39.305 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:39.305 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:39.591 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:39.592 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:39.604 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2021-08-21T15:04:38.345214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1760,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1416,"num_bytes_recovered":4218880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":344168,"kb_used_data":222864,"kb_used_omap":2,"kb_used_meta":121277,"kb_avail":282771352,"statfs":{"total":289910292480,"available":289557864448,"internally_reserved":0,"allocated":228212736,"data_stored":227626125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":124188560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":475136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001858"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5095,"reported_epoch":34,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:35.623081+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:35.623081+0000","last_peered":"2021-08-21T15:04:35.623081+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:35.623081+0000","last_undegraded":"2021-08-21T15:04:35.623081+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":392,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4530,"reported_epoch":34,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:28.747975+0000","last_change":"2021-08-21T15:04:28.747975+0000","last_active":"2021-08-21T15:04:28.747975+0000","last_peered":"2021-08-21T15:04:28.747975+0000","last_clean":"2021-08-21T15:04:28.747975+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:28.747975+0000","last_undegraded":"2021-08-21T15:04:28.747975+0000","last_fullsized":"2021-08-21T15:04:28.747975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4573,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.723233+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:27.723233+0000","last_peered":"2021-08-21T15:04:27.723233+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:27.723233+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5406,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723932+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:27.723932+0000","last_peered":"2021-08-21T15:04:27.723932+0000","last_clean":"2021-08-21T15:04:27.723932+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:27.723932+0000","last_undegraded":"2021-08-21T15:04:27.723932+0000","last_fullsized":"2021-08-21T15:04:27.723932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5190,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723328+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:27.723328+0000","last_peered":"2021-08-21T15:04:27.723328+0000","last_clean":"2021-08-21T15:04:27.723328+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:27.723328+0000","last_undegraded":"2021-08-21T15:04:27.723328+0000","last_fullsized":"2021-08-21T15:04:27.723328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4206,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.724093+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:27.724093+0000","last_peered":"2021-08-21T15:04:27.724093+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:27.724093+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4974,"reported_epoch":34,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:37.414873+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:37.414873+0000","last_peered":"2021-08-21T15:04:37.414873+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:37.414873+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":123,"num_bytes_recovered":503808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3371}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4711,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.723509+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:27.723509+0000","last_peered":"2021-08-21T15:04:27.723509+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:27.723509+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1760,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1416,"num_bytes_recovered":4218880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227401728,"data_stored":227401728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88416,"kb_used_data":54680,"kb_used_omap":1,"kb_used_meta":33726,"kb_avail":94283424,"statfs":{"total":96636764160,"available":96546226176,"internally_reserved":0,"allocated":55992320,"data_stored":55796783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":34536392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738400,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132188,"kb_used_data":85716,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239652,"statfs":{"total":96636764160,"available":96501403648,"internally_reserved":0,"allocated":87773184,"data_stored":87577647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.223},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280533,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123564,"kb_used_data":82468,"kb_used_omap":1,"kb_used_meta":41086,"kb_avail":94248276,"statfs":{"total":96636764160,"available":96510234624,"internally_reserved":0,"allocated":84447232,"data_stored":84251695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42073032},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.183}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84209664,"data_stored":84209664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:42.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:42.915 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:42.916 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:42.923 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2021-08-21T15:04:42.770764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1702,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1532,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":328220,"kb_used_data":223108,"kb_used_omap":2,"kb_used_meta":105085,"kb_avail":282787300,"statfs":{"total":289910292480,"available":289574195200,"internally_reserved":0,"allocated":228462592,"data_stored":227870660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":107607952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":475136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.426334"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5211,"reported_epoch":34,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:40.606948+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:40.606948+0000","last_peered":"2021-08-21T15:04:40.606948+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:40.606948+0000","last_undegraded":"2021-08-21T15:04:40.606948+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":450,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4531,"reported_epoch":34,"state":"active+clean","last_fresh":"2021-08-21T15:04:28.748626+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:28.748626+0000","last_peered":"2021-08-21T15:04:28.748626+0000","last_clean":"2021-08-21T15:04:28.748626+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:28.748626+0000","last_undegraded":"2021-08-21T15:04:28.748626+0000","last_fullsized":"2021-08-21T15:04:28.748626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4574,"reported_epoch":34,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:28.735614+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:28.735614+0000","last_peered":"2021-08-21T15:04:28.735614+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:28.735614+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5406,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723932+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:27.723932+0000","last_peered":"2021-08-21T15:04:27.723932+0000","last_clean":"2021-08-21T15:04:27.723932+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:27.723932+0000","last_undegraded":"2021-08-21T15:04:27.723932+0000","last_fullsized":"2021-08-21T15:04:27.723932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5191,"reported_epoch":34,"state":"active+clean","last_fresh":"2021-08-21T15:04:28.735556+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:28.735556+0000","last_peered":"2021-08-21T15:04:28.735556+0000","last_clean":"2021-08-21T15:04:28.735556+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:28.735556+0000","last_undegraded":"2021-08-21T15:04:28.735556+0000","last_fullsized":"2021-08-21T15:04:28.735556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4206,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.724093+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:27.724093+0000","last_peered":"2021-08-21T15:04:27.724093+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:27.724093+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":5091,"reported_epoch":35,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:42.398378+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:42.398378+0000","last_peered":"2021-08-21T15:04:42.398378+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:42.398378+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":137,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":741376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3429}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4712,"reported_epoch":34,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:28.735816+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:28.735816+0000","last_peered":"2021-08-21T15:04:28.735816+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:28.735816+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1702,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1532,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227639296,"data_stored":227639296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72096,"kb_used_data":54680,"kb_used_omap":1,"kb_used_meta":17406,"kb_avail":94299744,"statfs":{"total":96636764160,"available":96562937856,"internally_reserved":0,"allocated":55992320,"data_stored":55796783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":17824712},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738401,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132196,"kb_used_data":85724,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239644,"statfs":{"total":96636764160,"available":96501395456,"internally_reserved":0,"allocated":87781376,"data_stored":87580518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19900000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280534,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123928,"kb_used_data":82704,"kb_used_omap":1,"kb_used_meta":41214,"kb_avail":94247912,"statfs":{"total":96636764160,"available":96509861888,"internally_reserved":0,"allocated":84688896,"data_stored":84493359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42204104},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84447232,"data_stored":84447232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:42.925 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:43.278 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:43.279 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1760/55734 objects degraded (3.158%), 4 pgs degraded, 1 pg undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":149,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":36,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":4},"pgmap":{"pgs_by_state":[{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":3},{"state_name":"active+clean","count":3},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":336089088,"bytes_avail":289574203392,"bytes_total":289910292480,"degraded_objects":1760,"degraded_total":55734,"degraded_ratio":0.031578569634334516,"recovering_objects_per_sec":23,"recovering_bytes_per_sec":47504,"recovering_keys_per_sec":0,"num_objects_recovered":232,"num_bytes_recovered":475136,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:43.291 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:43.291 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:43.598 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:43.598 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:43.604 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2021-08-21T15:04:42.770764+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1702,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1532,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":328220,"kb_used_data":223108,"kb_used_omap":2,"kb_used_meta":105085,"kb_avail":282787300,"statfs":{"total":289910292480,"available":289574195200,"internally_reserved":0,"allocated":228462592,"data_stored":227870660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":107607952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":475136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.426334"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5211,"reported_epoch":34,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:40.606948+0000","last_change":"2021-08-21T15:04:02.537189+0000","last_active":"2021-08-21T15:04:40.606948+0000","last_peered":"2021-08-21T15:04:40.606948+0000","last_clean":"2021-08-21T15:02:55.800166+0000","last_became_active":"2021-08-21T15:04:02.010779+0000","last_became_peered":"2021-08-21T15:04:02.010779+0000","last_unstale":"2021-08-21T15:04:40.606948+0000","last_undegraded":"2021-08-21T15:04:40.606948+0000","last_fullsized":"2021-08-21T15:04:01.649631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":450,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3355}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4531,"reported_epoch":34,"state":"active+clean","last_fresh":"2021-08-21T15:04:28.748626+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:28.748626+0000","last_peered":"2021-08-21T15:04:28.748626+0000","last_clean":"2021-08-21T15:04:28.748626+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:28.748626+0000","last_undegraded":"2021-08-21T15:04:28.748626+0000","last_fullsized":"2021-08-21T15:04:28.748626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4574,"reported_epoch":34,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:28.735614+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:28.735614+0000","last_peered":"2021-08-21T15:04:28.735614+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:28.735614+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5406,"reported_epoch":33,"state":"active+clean","last_fresh":"2021-08-21T15:04:27.723932+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:27.723932+0000","last_peered":"2021-08-21T15:04:27.723932+0000","last_clean":"2021-08-21T15:04:27.723932+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:27.723932+0000","last_undegraded":"2021-08-21T15:04:27.723932+0000","last_fullsized":"2021-08-21T15:04:27.723932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5191,"reported_epoch":34,"state":"active+clean","last_fresh":"2021-08-21T15:04:28.735556+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:28.735556+0000","last_peered":"2021-08-21T15:04:28.735556+0000","last_clean":"2021-08-21T15:04:28.735556+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:28.735556+0000","last_undegraded":"2021-08-21T15:04:28.735556+0000","last_fullsized":"2021-08-21T15:04:28.735556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4206,"reported_epoch":33,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:27.724093+0000","last_change":"2021-08-21T15:04:02.025307+0000","last_active":"2021-08-21T15:04:27.724093+0000","last_peered":"2021-08-21T15:04:27.724093+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:27.724093+0000","last_undegraded":"2021-08-21T15:04:01.659782+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":505,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":5091,"reported_epoch":35,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:42.398378+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:42.398378+0000","last_peered":"2021-08-21T15:04:42.398378+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:42.398378+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":137,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":741376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3429}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4712,"reported_epoch":34,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:28.735816+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:28.735816+0000","last_peered":"2021-08-21T15:04:28.735816+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:28.735816+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1702,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1532,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227639296,"data_stored":227639296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":11,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72096,"kb_used_data":54680,"kb_used_omap":1,"kb_used_meta":17406,"kb_avail":94299744,"statfs":{"total":96636764160,"available":96562937856,"internally_reserved":0,"allocated":55992320,"data_stored":55796783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":17824712},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738401,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132196,"kb_used_data":85724,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239644,"statfs":{"total":96636764160,"available":96501395456,"internally_reserved":0,"allocated":87781376,"data_stored":87580518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19900000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280534,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123928,"kb_used_data":82704,"kb_used_omap":1,"kb_used_meta":41214,"kb_avail":94247912,"statfs":{"total":96636764160,"available":96509861888,"internally_reserved":0,"allocated":84688896,"data_stored":84493359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42204104},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84447232,"data_stored":84447232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:46.607 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:46.897 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:46.899 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:46.910 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2021-08-21T15:04:46.346550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1590,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":328784,"kb_used_data":223416,"kb_used_omap":2,"kb_used_meta":105341,"kb_avail":282786736,"statfs":{"total":289910292480,"available":289573617664,"internally_reserved":0,"allocated":228777984,"data_stored":228164726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":107870096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-563,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":237568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001335"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5246,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.785777+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:42.785777+0000","last_peered":"2021-08-21T15:04:42.785777+0000","last_clean":"2021-08-21T15:04:42.785777+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:42.785777+0000","last_undegraded":"2021-08-21T15:04:42.785777+0000","last_fullsized":"2021-08-21T15:04:42.785777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4533,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769857+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:41.769857+0000","last_peered":"2021-08-21T15:04:41.769857+0000","last_clean":"2021-08-21T15:04:41.769857+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:41.769857+0000","last_undegraded":"2021-08-21T15:04:41.769857+0000","last_fullsized":"2021-08-21T15:04:41.769857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4574,"reported_epoch":34,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:28.735614+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:28.735614+0000","last_peered":"2021-08-21T15:04:28.735614+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:28.735614+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5408,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769817+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:41.769817+0000","last_peered":"2021-08-21T15:04:41.769817+0000","last_clean":"2021-08-21T15:04:41.769817+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:41.769817+0000","last_undegraded":"2021-08-21T15:04:41.769817+0000","last_fullsized":"2021-08-21T15:04:41.769817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5191,"reported_epoch":34,"state":"active+clean","last_fresh":"2021-08-21T15:04:28.735556+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:28.735556+0000","last_peered":"2021-08-21T15:04:28.735556+0000","last_clean":"2021-08-21T15:04:28.735556+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:28.735556+0000","last_undegraded":"2021-08-21T15:04:28.735556+0000","last_fullsized":"2021-08-21T15:04:28.735556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4301,"reported_epoch":36,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:45.592373+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:04:45.592373+0000","last_peered":"2021-08-21T15:04:45.592373+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:45.592373+0000","last_undegraded":"2021-08-21T15:04:45.592373+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":5091,"reported_epoch":35,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:42.398378+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:42.398378+0000","last_peered":"2021-08-21T15:04:42.398378+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:42.398378+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":137,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":741376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3429}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4712,"reported_epoch":34,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:28.735816+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:28.735816+0000","last_peered":"2021-08-21T15:04:28.735816+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:28.735816+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1590,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227876864,"data_stored":227876864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72240,"kb_used_data":54696,"kb_used_omap":1,"kb_used_meta":17534,"kb_avail":94299600,"statfs":{"total":96636764160,"available":96562790400,"internally_reserved":0,"allocated":56008704,"data_stored":55802504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":17955784},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.189}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738401,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132196,"kb_used_data":85724,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239644,"statfs":{"total":96636764160,"available":96501395456,"internally_reserved":0,"allocated":87781376,"data_stored":87580518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19900000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280535,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":82996,"kb_used_omap":1,"kb_used_meta":41342,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":84987904,"data_stored":84781704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42335176},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84684800,"data_stored":84684800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:46.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:47.275 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:47.275 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1197/55734 objects degraded (2.148%), 3 pgs degraded, 1 pg undersized","count":4},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":153,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":36,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":4},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":336674816,"bytes_avail":289573617664,"bytes_total":289910292480,"degraded_objects":1197,"degraded_total":55734,"degraded_ratio":0.021477015825169556,"recovering_objects_per_sec":21,"recovering_bytes_per_sec":29691,"recovering_keys_per_sec":0,"num_objects_recovered":174,"num_bytes_recovered":237568,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:47.288 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:47.288 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:47.598 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:47.600 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:47.611 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2021-08-21T15:04:46.346550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1590,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":328784,"kb_used_data":223416,"kb_used_omap":2,"kb_used_meta":105341,"kb_avail":282786736,"statfs":{"total":289910292480,"available":289573617664,"internally_reserved":0,"allocated":228777984,"data_stored":228164726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":107870096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-563,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":237568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001335"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5246,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.785777+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:42.785777+0000","last_peered":"2021-08-21T15:04:42.785777+0000","last_clean":"2021-08-21T15:04:42.785777+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:42.785777+0000","last_undegraded":"2021-08-21T15:04:42.785777+0000","last_fullsized":"2021-08-21T15:04:42.785777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4533,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769857+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:41.769857+0000","last_peered":"2021-08-21T15:04:41.769857+0000","last_clean":"2021-08-21T15:04:41.769857+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:41.769857+0000","last_undegraded":"2021-08-21T15:04:41.769857+0000","last_fullsized":"2021-08-21T15:04:41.769857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4574,"reported_epoch":34,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:28.735614+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:28.735614+0000","last_peered":"2021-08-21T15:04:28.735614+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:28.735614+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5408,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769817+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:41.769817+0000","last_peered":"2021-08-21T15:04:41.769817+0000","last_clean":"2021-08-21T15:04:41.769817+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:41.769817+0000","last_undegraded":"2021-08-21T15:04:41.769817+0000","last_fullsized":"2021-08-21T15:04:41.769817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5191,"reported_epoch":34,"state":"active+clean","last_fresh":"2021-08-21T15:04:28.735556+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:28.735556+0000","last_peered":"2021-08-21T15:04:28.735556+0000","last_clean":"2021-08-21T15:04:28.735556+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:28.735556+0000","last_undegraded":"2021-08-21T15:04:28.735556+0000","last_fullsized":"2021-08-21T15:04:28.735556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4301,"reported_epoch":36,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:45.592373+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:04:45.592373+0000","last_peered":"2021-08-21T15:04:45.592373+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:45.592373+0000","last_undegraded":"2021-08-21T15:04:45.592373+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":5091,"reported_epoch":35,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:42.398378+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:42.398378+0000","last_peered":"2021-08-21T15:04:42.398378+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:42.398378+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":137,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":741376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3429}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4712,"reported_epoch":34,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:28.735816+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:28.735816+0000","last_peered":"2021-08-21T15:04:28.735816+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:28.735816+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1197,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1590,"num_bytes_recovered":4456448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227876864,"data_stored":227876864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72240,"kb_used_data":54696,"kb_used_omap":1,"kb_used_meta":17534,"kb_avail":94299600,"statfs":{"total":96636764160,"available":96562790400,"internally_reserved":0,"allocated":56008704,"data_stored":55802504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":17955784},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.189}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738401,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132196,"kb_used_data":85724,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239644,"statfs":{"total":96636764160,"available":96501395456,"internally_reserved":0,"allocated":87781376,"data_stored":87580518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19900000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280535,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":82996,"kb_used_omap":1,"kb_used_meta":41342,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":84987904,"data_stored":84781704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42335176},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84684800,"data_stored":84684800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:50.613 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:50.912 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:50.913 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:50.929 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2021-08-21T15:04:50.347190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1138,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":4698112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":328856,"kb_used_data":223424,"kb_used_omap":2,"kb_used_meta":105405,"kb_avail":282786664,"statfs":{"total":289910292480,"available":289573543936,"internally_reserved":0,"allocated":228786176,"data_stored":228167576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":107935632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-622,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":479232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.579497"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5246,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.785777+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:42.785777+0000","last_peered":"2021-08-21T15:04:42.785777+0000","last_clean":"2021-08-21T15:04:42.785777+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:42.785777+0000","last_undegraded":"2021-08-21T15:04:42.785777+0000","last_fullsized":"2021-08-21T15:04:42.785777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4533,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769857+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:41.769857+0000","last_peered":"2021-08-21T15:04:41.769857+0000","last_clean":"2021-08-21T15:04:41.769857+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:41.769857+0000","last_undegraded":"2021-08-21T15:04:41.769857+0000","last_fullsized":"2021-08-21T15:04:41.769857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4575,"reported_epoch":35,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:41.796882+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:41.796882+0000","last_peered":"2021-08-21T15:04:41.796882+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:41.796882+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5408,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769817+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:41.769817+0000","last_peered":"2021-08-21T15:04:41.769817+0000","last_clean":"2021-08-21T15:04:41.769817+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:41.769817+0000","last_undegraded":"2021-08-21T15:04:41.769817+0000","last_fullsized":"2021-08-21T15:04:41.769817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5192,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.796718+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:41.796718+0000","last_peered":"2021-08-21T15:04:41.796718+0000","last_clean":"2021-08-21T15:04:41.796718+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:41.796718+0000","last_undegraded":"2021-08-21T15:04:41.796718+0000","last_fullsized":"2021-08-21T15:04:41.796718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4301,"reported_epoch":36,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:45.592373+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:04:45.592373+0000","last_peered":"2021-08-21T15:04:45.592373+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:45.592373+0000","last_undegraded":"2021-08-21T15:04:45.592373+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":5210,"reported_epoch":36,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:47.469508+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:47.469508+0000","last_peered":"2021-08-21T15:04:47.469508+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:47.469508+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":78,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3488}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4713,"reported_epoch":35,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:41.796811+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:41.796811+0000","last_peered":"2021-08-21T15:04:41.796811+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:41.796811+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1138,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":4698112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227876864,"data_stored":227876864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018892,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72304,"kb_used_data":54696,"kb_used_omap":1,"kb_used_meta":17598,"kb_avail":94299536,"statfs":{"total":96636764160,"available":96562724864,"internally_reserved":0,"allocated":56008704,"data_stored":55802504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18021320},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132204,"kb_used_data":85732,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239636,"statfs":{"total":96636764160,"available":96501387264,"internally_reserved":0,"allocated":87789568,"data_stored":87583368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]}]},{"osd":1,"up_from":22,"seq":94489280535,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":82996,"kb_used_omap":1,"kb_used_meta":41342,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":84987904,"data_stored":84781704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42335176},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84684800,"data_stored":84684800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:50.930 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:51.284 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:51.284 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1138/55734 objects degraded (2.042%), 3 pgs degraded, 1 pg undersized","count":4},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":157,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":36,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":4},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":336748544,"bytes_avail":289573543936,"bytes_total":289910292480,"degraded_objects":1138,"degraded_total":55734,"degraded_ratio":0.020418416047654934,"recovering_objects_per_sec":20,"recovering_bytes_per_sec":55857,"recovering_keys_per_sec":0,"num_objects_recovered":175,"num_bytes_recovered":479232,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:51.297 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:51.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:51.596 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:51.598 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:51.609 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2021-08-21T15:04:50.347190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1138,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":4698112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":328856,"kb_used_data":223424,"kb_used_omap":2,"kb_used_meta":105405,"kb_avail":282786664,"statfs":{"total":289910292480,"available":289573543936,"internally_reserved":0,"allocated":228786176,"data_stored":228167576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":107935632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-622,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":479232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.579497"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5246,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.785777+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:42.785777+0000","last_peered":"2021-08-21T15:04:42.785777+0000","last_clean":"2021-08-21T15:04:42.785777+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:42.785777+0000","last_undegraded":"2021-08-21T15:04:42.785777+0000","last_fullsized":"2021-08-21T15:04:42.785777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4533,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769857+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:41.769857+0000","last_peered":"2021-08-21T15:04:41.769857+0000","last_clean":"2021-08-21T15:04:41.769857+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:41.769857+0000","last_undegraded":"2021-08-21T15:04:41.769857+0000","last_fullsized":"2021-08-21T15:04:41.769857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4575,"reported_epoch":35,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:41.796882+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:41.796882+0000","last_peered":"2021-08-21T15:04:41.796882+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:41.796882+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5408,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769817+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:41.769817+0000","last_peered":"2021-08-21T15:04:41.769817+0000","last_clean":"2021-08-21T15:04:41.769817+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:41.769817+0000","last_undegraded":"2021-08-21T15:04:41.769817+0000","last_fullsized":"2021-08-21T15:04:41.769817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5192,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.796718+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:41.796718+0000","last_peered":"2021-08-21T15:04:41.796718+0000","last_clean":"2021-08-21T15:04:41.796718+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:41.796718+0000","last_undegraded":"2021-08-21T15:04:41.796718+0000","last_fullsized":"2021-08-21T15:04:41.796718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4301,"reported_epoch":36,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:45.592373+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:04:45.592373+0000","last_peered":"2021-08-21T15:04:45.592373+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:45.592373+0000","last_undegraded":"2021-08-21T15:04:45.592373+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":5210,"reported_epoch":36,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:47.469508+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:47.469508+0000","last_peered":"2021-08-21T15:04:47.469508+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:47.469508+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":78,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3488}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4713,"reported_epoch":35,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:41.796811+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:41.796811+0000","last_peered":"2021-08-21T15:04:41.796811+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:41.796811+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1138,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":4698112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227876864,"data_stored":227876864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018892,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72304,"kb_used_data":54696,"kb_used_omap":1,"kb_used_meta":17598,"kb_avail":94299536,"statfs":{"total":96636764160,"available":96562724864,"internally_reserved":0,"allocated":56008704,"data_stored":55802504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18021320},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132204,"kb_used_data":85732,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239636,"statfs":{"total":96636764160,"available":96501387264,"internally_reserved":0,"allocated":87789568,"data_stored":87583368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]}]},{"osd":1,"up_from":22,"seq":94489280535,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":82996,"kb_used_omap":1,"kb_used_meta":41342,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":84987904,"data_stored":84781704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42335176},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84684800,"data_stored":84684800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:54.612 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:54.910 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:54.912 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:54.923 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2021-08-21T15:04:54.795656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1080,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1765,"num_bytes_recovered":4935680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329216,"kb_used_data":223656,"kb_used_omap":2,"kb_used_meta":105533,"kb_avail":282786304,"statfs":{"total":289910292480,"available":289573175296,"internally_reserved":0,"allocated":229023744,"data_stored":228405144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108066704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-622,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":233,"num_bytes_recovered":479232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.449395"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5246,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.785777+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:42.785777+0000","last_peered":"2021-08-21T15:04:42.785777+0000","last_clean":"2021-08-21T15:04:42.785777+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:42.785777+0000","last_undegraded":"2021-08-21T15:04:42.785777+0000","last_fullsized":"2021-08-21T15:04:42.785777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4533,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769857+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:41.769857+0000","last_peered":"2021-08-21T15:04:41.769857+0000","last_clean":"2021-08-21T15:04:41.769857+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:41.769857+0000","last_undegraded":"2021-08-21T15:04:41.769857+0000","last_fullsized":"2021-08-21T15:04:41.769857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4575,"reported_epoch":35,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:41.796882+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:41.796882+0000","last_peered":"2021-08-21T15:04:41.796882+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:41.796882+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5408,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769817+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:41.769817+0000","last_peered":"2021-08-21T15:04:41.769817+0000","last_clean":"2021-08-21T15:04:41.769817+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:41.769817+0000","last_undegraded":"2021-08-21T15:04:41.769817+0000","last_fullsized":"2021-08-21T15:04:41.769817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5192,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.796718+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:41.796718+0000","last_peered":"2021-08-21T15:04:41.796718+0000","last_clean":"2021-08-21T15:04:41.796718+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:41.796718+0000","last_undegraded":"2021-08-21T15:04:41.796718+0000","last_fullsized":"2021-08-21T15:04:41.796718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4417,"reported_epoch":36,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:50.576661+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:04:50.576661+0000","last_peered":"2021-08-21T15:04:50.576661+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:50.576661+0000","last_undegraded":"2021-08-21T15:04:50.576661+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":5326,"reported_epoch":36,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:52.452886+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:52.452886+0000","last_peered":"2021-08-21T15:04:52.452886+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:52.452886+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":1220608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3546}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4713,"reported_epoch":35,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:41.796811+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:41.796811+0000","last_peered":"2021-08-21T15:04:41.796811+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:41.796811+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1080,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1765,"num_bytes_recovered":4935680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228118528,"data_stored":228118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018893,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72368,"kb_used_data":54696,"kb_used_omap":1,"kb_used_meta":17662,"kb_avail":94299472,"statfs":{"total":96636764160,"available":96562659328,"internally_reserved":0,"allocated":56008704,"data_stored":55802504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18086856},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]}]},{"osd":0,"up_from":8,"seq":34359738403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132204,"kb_used_data":85732,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239636,"statfs":{"total":96636764160,"available":96501387264,"internally_reserved":0,"allocated":87789568,"data_stored":87583368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280536,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124644,"kb_used_data":83228,"kb_used_omap":1,"kb_used_meta":41406,"kb_avail":94247196,"statfs":{"total":96636764160,"available":96509128704,"internally_reserved":0,"allocated":85225472,"data_stored":85019272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42400712},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.16},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.183}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":84926464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:54.924 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:55.278 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:55.279 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1080/55734 objects degraded (1.938%), 3 pgs degraded, 1 pg undersized","count":4},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":161,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":37,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":337117184,"bytes_avail":289573175296,"bytes_total":289910292480,"degraded_objects":1080,"degraded_total":55734,"degraded_ratio":0.019377758639250727,"recovering_objects_per_sec":20,"recovering_bytes_per_sec":41395,"recovering_keys_per_sec":0,"num_objects_recovered":233,"num_bytes_recovered":479232,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:55.291 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:04:55.292 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:55.591 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:55.592 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:55.603 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2021-08-21T15:04:54.795656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1080,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1765,"num_bytes_recovered":4935680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329216,"kb_used_data":223656,"kb_used_omap":2,"kb_used_meta":105533,"kb_avail":282786304,"statfs":{"total":289910292480,"available":289573175296,"internally_reserved":0,"allocated":229023744,"data_stored":228405144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108066704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-622,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":233,"num_bytes_recovered":479232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.449395"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5246,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.785777+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:42.785777+0000","last_peered":"2021-08-21T15:04:42.785777+0000","last_clean":"2021-08-21T15:04:42.785777+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:42.785777+0000","last_undegraded":"2021-08-21T15:04:42.785777+0000","last_fullsized":"2021-08-21T15:04:42.785777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4533,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769857+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:41.769857+0000","last_peered":"2021-08-21T15:04:41.769857+0000","last_clean":"2021-08-21T15:04:41.769857+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:41.769857+0000","last_undegraded":"2021-08-21T15:04:41.769857+0000","last_fullsized":"2021-08-21T15:04:41.769857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4575,"reported_epoch":35,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:41.796882+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:41.796882+0000","last_peered":"2021-08-21T15:04:41.796882+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:41.796882+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5408,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.769817+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:41.769817+0000","last_peered":"2021-08-21T15:04:41.769817+0000","last_clean":"2021-08-21T15:04:41.769817+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:41.769817+0000","last_undegraded":"2021-08-21T15:04:41.769817+0000","last_fullsized":"2021-08-21T15:04:41.769817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5192,"reported_epoch":35,"state":"active+clean","last_fresh":"2021-08-21T15:04:41.796718+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:41.796718+0000","last_peered":"2021-08-21T15:04:41.796718+0000","last_clean":"2021-08-21T15:04:41.796718+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:41.796718+0000","last_undegraded":"2021-08-21T15:04:41.796718+0000","last_fullsized":"2021-08-21T15:04:41.796718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4417,"reported_epoch":36,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:50.576661+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:04:50.576661+0000","last_peered":"2021-08-21T15:04:50.576661+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:50.576661+0000","last_undegraded":"2021-08-21T15:04:50.576661+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":5326,"reported_epoch":36,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:52.452886+0000","last_change":"2021-08-21T15:04:26.927244+0000","last_active":"2021-08-21T15:04:52.452886+0000","last_peered":"2021-08-21T15:04:52.452886+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:52.452886+0000","last_undegraded":"2021-08-21T15:03:09.474453+0000","last_fullsized":"2021-08-21T15:03:09.458733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":1220608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3546}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4713,"reported_epoch":35,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:41.796811+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:41.796811+0000","last_peered":"2021-08-21T15:04:41.796811+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:41.796811+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1080,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1765,"num_bytes_recovered":4935680,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228118528,"data_stored":228118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018893,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72368,"kb_used_data":54696,"kb_used_omap":1,"kb_used_meta":17662,"kb_avail":94299472,"statfs":{"total":96636764160,"available":96562659328,"internally_reserved":0,"allocated":56008704,"data_stored":55802504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18086856},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]}]},{"osd":0,"up_from":8,"seq":34359738403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132204,"kb_used_data":85732,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239636,"statfs":{"total":96636764160,"available":96501387264,"internally_reserved":0,"allocated":87789568,"data_stored":87583368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280536,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124644,"kb_used_data":83228,"kb_used_omap":1,"kb_used_meta":41406,"kb_avail":94247196,"statfs":{"total":96636764160,"available":96509128704,"internally_reserved":0,"allocated":85225472,"data_stored":85019272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42400712},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.16},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.183}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":84926464,"data_stored":84926464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:58.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:58.905 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:58.905 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:58.916 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2021-08-21T15:04:58.348453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1526,"num_bytes_recovered":3715072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329528,"kb_used_data":223840,"kb_used_omap":2,"kb_used_meta":105661,"kb_avail":282785992,"statfs":{"total":289910292480,"available":289572855808,"internally_reserved":0,"allocated":229212160,"data_stored":228582847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108197776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-78,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-123,"num_bytes_recovered":-983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001262"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5247,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.786331+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:42.786331+0000","last_peered":"2021-08-21T15:04:42.786331+0000","last_clean":"2021-08-21T15:04:42.786331+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:42.786331+0000","last_undegraded":"2021-08-21T15:04:42.786331+0000","last_fullsized":"2021-08-21T15:04:42.786331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4534,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.774403+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:42.774403+0000","last_peered":"2021-08-21T15:04:42.774403+0000","last_clean":"2021-08-21T15:04:42.774403+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:42.774403+0000","last_undegraded":"2021-08-21T15:04:42.774403+0000","last_fullsized":"2021-08-21T15:04:42.774403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5409,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.774209+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:42.774209+0000","last_peered":"2021-08-21T15:04:42.774209+0000","last_clean":"2021-08-21T15:04:42.774209+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:42.774209+0000","last_undegraded":"2021-08-21T15:04:42.774209+0000","last_fullsized":"2021-08-21T15:04:42.774209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4536,"reported_epoch":37,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:55.647637+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:04:55.647637+0000","last_peered":"2021-08-21T15:04:55.647637+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:55.647637+0000","last_undegraded":"2021-08-21T15:04:55.647637+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4724,"reported_epoch":37,"state":"peering","last_fresh":"2021-08-21T15:04:54.797888+0000","last_change":"2021-08-21T15:04:54.795347+0000","last_active":"2021-08-21T15:04:54.795190+0000","last_peered":"2021-08-21T15:03:52.528007+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:54.797888+0000","last_undegraded":"2021-08-21T15:04:54.797888+0000","last_fullsized":"2021-08-21T15:04:54.797888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1526,"num_bytes_recovered":3715072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018893,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72368,"kb_used_data":54696,"kb_used_omap":1,"kb_used_meta":17662,"kb_avail":94299472,"statfs":{"total":96636764160,"available":96562659328,"internally_reserved":0,"allocated":56008704,"data_stored":55802504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18086856},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]}]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.16500000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]}]},{"osd":1,"up_from":22,"seq":94489280537,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124940,"kb_used_data":83396,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246900,"statfs":{"total":96636764160,"available":96508825600,"internally_reserved":0,"allocated":85397504,"data_stored":85191304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.17499999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:04:58.917 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:04:59.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:59.263 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 1 pg peering","count":1},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1060/55734 objects degraded (1.902%), 2 pgs degraded","count":2},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":165,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":38,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":337436672,"bytes_avail":289572855808,"bytes_total":289910292480,"inactive_pgs_ratio":0.125,"degraded_objects":1060,"degraded_total":55734,"degraded_ratio":0.01901891125704238},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2021-08-21T15:04:06.339652+0000","services":{"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-08-21T15:04:59.276 INFO:tasks.osd_recovery.ceph_manager:no progress seen, keeping timeout for now 2021-08-21T15:04:59.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:04:59.579 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:04:59.594 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:04:59.595 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2021-08-21T15:04:58.348453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1526,"num_bytes_recovered":3715072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329528,"kb_used_data":223840,"kb_used_omap":2,"kb_used_meta":105661,"kb_avail":282785992,"statfs":{"total":289910292480,"available":289572855808,"internally_reserved":0,"allocated":229212160,"data_stored":228582847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108197776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-78,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-123,"num_bytes_recovered":-983040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001262"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5247,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.786331+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:42.786331+0000","last_peered":"2021-08-21T15:04:42.786331+0000","last_clean":"2021-08-21T15:04:42.786331+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:42.786331+0000","last_undegraded":"2021-08-21T15:04:42.786331+0000","last_fullsized":"2021-08-21T15:04:42.786331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4534,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.774403+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:42.774403+0000","last_peered":"2021-08-21T15:04:42.774403+0000","last_clean":"2021-08-21T15:04:42.774403+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:42.774403+0000","last_undegraded":"2021-08-21T15:04:42.774403+0000","last_fullsized":"2021-08-21T15:04:42.774403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5409,"reported_epoch":36,"state":"active+clean","last_fresh":"2021-08-21T15:04:42.774209+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:42.774209+0000","last_peered":"2021-08-21T15:04:42.774209+0000","last_clean":"2021-08-21T15:04:42.774209+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:42.774209+0000","last_undegraded":"2021-08-21T15:04:42.774209+0000","last_fullsized":"2021-08-21T15:04:42.774209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4536,"reported_epoch":37,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:04:55.647637+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:04:55.647637+0000","last_peered":"2021-08-21T15:04:55.647637+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:04:55.647637+0000","last_undegraded":"2021-08-21T15:04:55.647637+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4724,"reported_epoch":37,"state":"peering","last_fresh":"2021-08-21T15:04:54.797888+0000","last_change":"2021-08-21T15:04:54.795347+0000","last_active":"2021-08-21T15:04:54.795190+0000","last_peered":"2021-08-21T15:03:52.528007+0000","last_clean":"2021-08-21T15:02:57.836879+0000","last_became_active":"2021-08-21T15:03:09.498622+0000","last_became_peered":"2021-08-21T15:03:09.498622+0000","last_unstale":"2021-08-21T15:04:54.797888+0000","last_undegraded":"2021-08-21T15:04:54.797888+0000","last_fullsized":"2021-08-21T15:04:54.797888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1526,"num_bytes_recovered":3715072,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018893,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72368,"kb_used_data":54696,"kb_used_omap":1,"kb_used_meta":17662,"kb_avail":94299472,"statfs":{"total":96636764160,"available":96562659328,"internally_reserved":0,"allocated":56008704,"data_stored":55802504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18086856},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.191}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]}]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.16500000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]}]},{"osd":1,"up_from":22,"seq":94489280537,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124940,"kb_used_data":83396,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246900,"statfs":{"total":96636764160,"available":96508825600,"internally_reserved":0,"allocated":85397504,"data_stored":85191304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.17499999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:02.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:02.887 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:02.889 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:02.899 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2021-08-21T15:05:02.349126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1902,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329624,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":105725,"kb_avail":282785896,"statfs":{"total":289910292480,"available":289572757504,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108263312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":81920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001313"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4653,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:00.631072+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:00.631072+0000","last_peered":"2021-08-21T15:05:00.631072+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:00.631072+0000","last_undegraded":"2021-08-21T15:05:00.631072+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4732,"reported_epoch":38,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:55.805970+0000","last_change":"2021-08-21T15:04:55.805970+0000","last_active":"2021-08-21T15:04:55.805970+0000","last_peered":"2021-08-21T15:04:55.805970+0000","last_clean":"2021-08-21T15:04:55.805970+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.805970+0000","last_undegraded":"2021-08-21T15:04:55.805970+0000","last_fullsized":"2021-08-21T15:04:55.805970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1902,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72448,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":17726,"kb_avail":94299392,"statfs":{"total":96636764160,"available":96562577408,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18152392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.16500000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]}]},{"osd":1,"up_from":22,"seq":94489280538,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:02.901 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:03.259 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:03.259 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1060/55734 objects degraded (1.902%), 2 pgs degraded, 3 pgs undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":169,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":38,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+clean+wait","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":337534976,"bytes_avail":289572757504,"bytes_total":289910292480,"degraded_objects":1060,"degraded_total":55734,"degraded_ratio":0.01901891125704238,"recovering_objects_per_sec":17,"recovering_bytes_per_sec":10238,"recovering_keys_per_sec":0,"num_objects_recovered":137,"num_bytes_recovered":81920,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:03.265 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:03.265 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:03.549 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:03.550 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:03.562 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2021-08-21T15:05:02.349126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1902,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329624,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":105725,"kb_avail":282785896,"statfs":{"total":289910292480,"available":289572757504,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108263312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":81920,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001313"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4653,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:00.631072+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:00.631072+0000","last_peered":"2021-08-21T15:05:00.631072+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:00.631072+0000","last_undegraded":"2021-08-21T15:05:00.631072+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4732,"reported_epoch":38,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:55.805970+0000","last_change":"2021-08-21T15:04:55.805970+0000","last_active":"2021-08-21T15:04:55.805970+0000","last_peered":"2021-08-21T15:04:55.805970+0000","last_clean":"2021-08-21T15:04:55.805970+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.805970+0000","last_undegraded":"2021-08-21T15:04:55.805970+0000","last_fullsized":"2021-08-21T15:04:55.805970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1902,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72448,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":17726,"kb_avail":94299392,"statfs":{"total":96636764160,"available":96562577408,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18152392},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.16500000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.19500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.186}]}]},{"osd":1,"up_from":22,"seq":94489280538,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:06.565 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:06.847 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:06.849 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:06.860 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2021-08-21T15:05:06.349742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1960,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329688,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":105789,"kb_avail":282785832,"statfs":{"total":289910292480,"available":289572691968,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108328848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.556313"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4769,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:05.615339+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:05.615339+0000","last_peered":"2021-08-21T15:05:05.615339+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:05.615339+0000","last_undegraded":"2021-08-21T15:05:05.615339+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4732,"reported_epoch":38,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:55.805970+0000","last_change":"2021-08-21T15:04:55.805970+0000","last_active":"2021-08-21T15:04:55.805970+0000","last_peered":"2021-08-21T15:04:55.805970+0000","last_clean":"2021-08-21T15:04:55.805970+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.805970+0000","last_undegraded":"2021-08-21T15:04:55.805970+0000","last_fullsized":"2021-08-21T15:04:55.805970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1960,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72512,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":17790,"kb_avail":94299328,"statfs":{"total":96636764160,"available":96562511872,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18217928},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.246},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.19700000000000001}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.219},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.22900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.157},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.23000000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.189},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.19500000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.251}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:06.861 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:07.206 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:07.207 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1060/55734 objects degraded (1.902%), 2 pgs degraded, 3 pgs undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":173,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":38,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+clean+wait","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":337600512,"bytes_avail":289572691968,"bytes_total":289910292480,"degraded_objects":1060,"degraded_total":55734,"degraded_ratio":0.01901891125704238,"recovering_objects_per_sec":41,"recovering_bytes_per_sec":123388,"recovering_keys_per_sec":0,"num_objects_recovered":434,"num_bytes_recovered":1302528,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:07.219 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:07.220 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:07.505 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:07.506 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:07.517 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2021-08-21T15:05:06.349742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1960,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329688,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":105789,"kb_avail":282785832,"statfs":{"total":289910292480,"available":289572691968,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108328848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.556313"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4769,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:05.615339+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:05.615339+0000","last_peered":"2021-08-21T15:05:05.615339+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:05.615339+0000","last_undegraded":"2021-08-21T15:05:05.615339+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4732,"reported_epoch":38,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:55.805970+0000","last_change":"2021-08-21T15:04:55.805970+0000","last_active":"2021-08-21T15:04:55.805970+0000","last_peered":"2021-08-21T15:04:55.805970+0000","last_clean":"2021-08-21T15:04:55.805970+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.805970+0000","last_undegraded":"2021-08-21T15:04:55.805970+0000","last_fullsized":"2021-08-21T15:04:55.805970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1960,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72512,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":17790,"kb_avail":94299328,"statfs":{"total":96636764160,"available":96562511872,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18217928},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.246},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.19700000000000001}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.219},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.22900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.157},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.23000000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.189},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.19500000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.251}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:10.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:10.803 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:10.805 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:10.815 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2021-08-21T15:05:10.350459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1960,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329752,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":105853,"kb_avail":282785768,"statfs":{"total":289910292480,"available":289572626432,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108394384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002005"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4769,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:05.615339+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:05.615339+0000","last_peered":"2021-08-21T15:05:05.615339+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:05.615339+0000","last_undegraded":"2021-08-21T15:05:05.615339+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4732,"reported_epoch":38,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:55.805970+0000","last_change":"2021-08-21T15:04:55.805970+0000","last_active":"2021-08-21T15:04:55.805970+0000","last_peered":"2021-08-21T15:04:55.805970+0000","last_clean":"2021-08-21T15:04:55.805970+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.805970+0000","last_undegraded":"2021-08-21T15:04:55.805970+0000","last_fullsized":"2021-08-21T15:04:55.805970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1960,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018896,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72576,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":17854,"kb_avail":94299264,"statfs":{"total":96636764160,"available":96562446336,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18283464},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.20300000000000001}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.192},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.214}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.221}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.23400000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.251}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:10.818 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:11.167 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:11.167 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1060/55734 objects degraded (1.902%), 2 pgs degraded, 3 pgs undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":177,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":38,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"active+clean+wait","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":337666048,"bytes_avail":289572626432,"bytes_total":289910292480,"degraded_objects":1060,"degraded_total":55734,"degraded_ratio":0.01901891125704238,"recovering_objects_per_sec":36,"recovering_bytes_per_sec":108525,"recovering_keys_per_sec":0,"num_objects_recovered":434,"num_bytes_recovered":1302528,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:11.180 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:11.180 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:11.463 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:11.465 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:11.476 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2021-08-21T15:05:10.350459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1960,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":329752,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":105853,"kb_avail":282785768,"statfs":{"total":289910292480,"available":289572626432,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":108394384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":434,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002005"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4769,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:05.615339+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:05.615339+0000","last_peered":"2021-08-21T15:05:05.615339+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:05.615339+0000","last_undegraded":"2021-08-21T15:05:05.615339+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":279,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4732,"reported_epoch":38,"state":"active+clean+wait","last_fresh":"2021-08-21T15:04:55.805970+0000","last_change":"2021-08-21T15:04:55.805970+0000","last_active":"2021-08-21T15:04:55.805970+0000","last_peered":"2021-08-21T15:04:55.805970+0000","last_clean":"2021-08-21T15:04:55.805970+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.805970+0000","last_undegraded":"2021-08-21T15:04:55.805970+0000","last_fullsized":"2021-08-21T15:04:55.805970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1960,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018896,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72576,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":17854,"kb_avail":94299264,"statfs":{"total":96636764160,"available":96562446336,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":18283464},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.20300000000000001}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.192},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.214}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.221}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.23400000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280539,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.251}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:14.483 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:14.775 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:14.781 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:14.795 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2021-08-21T15:05:14.351155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2018,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333912,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":110013,"kb_avail":282781608,"statfs":{"total":289910292480,"available":289568366592,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112654224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002029"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4885,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:10.600239+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:10.600239+0000","last_peered":"2021-08-21T15:05:10.600239+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:10.600239+0000","last_undegraded":"2021-08-21T15:05:10.600239+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4733,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.806715+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:04:55.806715+0000","last_peered":"2021-08-21T15:04:55.806715+0000","last_clean":"2021-08-21T15:04:55.806715+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.806715+0000","last_undegraded":"2021-08-21T15:04:55.806715+0000","last_fullsized":"2021-08-21T15:04:55.806715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2018,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76736,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":22014,"kb_avail":94295104,"statfs":{"total":96636764160,"available":96558186496,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22543304},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.224}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20599999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.22}]}]},{"osd":1,"up_from":22,"seq":94489280540,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.251}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:14.797 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:15.168 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:15.168 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1060/55734 objects degraded (1.902%), 2 pgs degraded, 3 pgs undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":181,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":38,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":5},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":341925888,"bytes_avail":289568366592,"bytes_total":289910292480,"degraded_objects":1060,"degraded_total":55734,"degraded_ratio":0.01901891125704238,"recovering_objects_per_sec":9,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:15.182 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:15.182 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:15.465 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:15.467 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:15.478 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2021-08-21T15:05:14.351155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2018,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333912,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":110013,"kb_avail":282781608,"statfs":{"total":289910292480,"available":289568366592,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112654224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002029"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":4885,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:10.600239+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:10.600239+0000","last_peered":"2021-08-21T15:05:10.600239+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:10.600239+0000","last_undegraded":"2021-08-21T15:05:10.600239+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":337,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4733,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.806715+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:04:55.806715+0000","last_peered":"2021-08-21T15:04:55.806715+0000","last_clean":"2021-08-21T15:04:55.806715+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.806715+0000","last_undegraded":"2021-08-21T15:04:55.806715+0000","last_fullsized":"2021-08-21T15:04:55.806715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2018,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76736,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":22014,"kb_avail":94295104,"statfs":{"total":96636764160,"available":96558186496,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22543304},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.224}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20599999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.22}]}]},{"osd":1,"up_from":22,"seq":94489280540,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:04:08 2021","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.13900000000000001,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":4.4530000000000003,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.251}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:18.483 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:18.816 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:18.818 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:18.830 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2021-08-21T15:05:18.351760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2076,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333912,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":110013,"kb_avail":282781608,"statfs":{"total":289910292480,"available":289568366592,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112654224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002017"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5001,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:15.583952+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:15.583952+0000","last_peered":"2021-08-21T15:05:15.583952+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:15.583952+0000","last_undegraded":"2021-08-21T15:05:15.583952+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":395,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4733,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.806715+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:04:55.806715+0000","last_peered":"2021-08-21T15:04:55.806715+0000","last_clean":"2021-08-21T15:04:55.806715+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.806715+0000","last_undegraded":"2021-08-21T15:04:55.806715+0000","last_fullsized":"2021-08-21T15:04:55.806715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2076,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76736,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":22014,"kb_avail":94295104,"statfs":{"total":96636764160,"available":96558186496,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22543304},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.224}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.254}]}]},{"osd":1,"up_from":22,"seq":94489280541,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.25900000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.27600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:18.832 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:19.182 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:19.182 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1060/55734 objects degraded (1.902%), 2 pgs degraded, 3 pgs undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":185,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":38,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":5},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":341925888,"bytes_avail":289568366592,"bytes_total":289910292480,"degraded_objects":1060,"degraded_total":55734,"degraded_ratio":0.01901891125704238,"recovering_objects_per_sec":9,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:19.197 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:19.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:19.716 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:19.726 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2021-08-21T15:05:18.351760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2076,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333912,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":110013,"kb_avail":282781608,"statfs":{"total":289910292480,"available":289568366592,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112654224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002017"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5001,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:15.583952+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:15.583952+0000","last_peered":"2021-08-21T15:05:15.583952+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:15.583952+0000","last_undegraded":"2021-08-21T15:05:15.583952+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":395,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4733,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.806715+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:04:55.806715+0000","last_peered":"2021-08-21T15:04:55.806715+0000","last_clean":"2021-08-21T15:04:55.806715+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.806715+0000","last_undegraded":"2021-08-21T15:04:55.806715+0000","last_fullsized":"2021-08-21T15:04:55.806715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2076,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018897,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76736,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":22014,"kb_avail":94295104,"statfs":{"total":96636764160,"available":96558186496,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22543304},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.224}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.254}]}]},{"osd":1,"up_from":22,"seq":94489280541,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.25900000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.27600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:22.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:23.013 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:23.019 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:23.026 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-08-21T15:05:22.352391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2135,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333976,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":110077,"kb_avail":282781544,"statfs":{"total":289910292480,"available":289568301056,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112719760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001931"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5119,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:20.654153+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:20.654153+0000","last_peered":"2021-08-21T15:05:20.654153+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:20.654153+0000","last_undegraded":"2021-08-21T15:05:20.654153+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":454,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4733,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.806715+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:04:55.806715+0000","last_peered":"2021-08-21T15:04:55.806715+0000","last_clean":"2021-08-21T15:04:55.806715+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.806715+0000","last_undegraded":"2021-08-21T15:04:55.806715+0000","last_fullsized":"2021-08-21T15:04:55.806715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2135,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018898,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76800,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":22078,"kb_avail":94295040,"statfs":{"total":96636764160,"available":96558120960,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22608840},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.251},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.218}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.22900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.254}]}]},{"osd":1,"up_from":22,"seq":94489280542,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:23.028 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:23.379 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:23.380 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1060/55734 objects degraded (1.902%), 2 pgs degraded, 3 pgs undersized","count":5},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":189,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":38,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":3},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":5},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":341991424,"bytes_avail":289568301056,"bytes_total":289910292480,"degraded_objects":1060,"degraded_total":55734,"degraded_ratio":0.01901891125704238,"recovering_objects_per_sec":14,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:23.401 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:23.430 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:23.723 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:23.723 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:23.730 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-08-21T15:05:22.352391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2135,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":333976,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":110077,"kb_avail":282781544,"statfs":{"total":289910292480,"available":289568301056,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112719760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001931"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5248,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.795090+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:54.795090+0000","last_peered":"2021-08-21T15:04:54.795090+0000","last_clean":"2021-08-21T15:04:54.795090+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:54.795090+0000","last_undegraded":"2021-08-21T15:04:54.795090+0000","last_fullsized":"2021-08-21T15:04:54.795090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4535,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794997+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:54.794997+0000","last_peered":"2021-08-21T15:04:54.794997+0000","last_clean":"2021-08-21T15:04:54.794997+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:54.794997+0000","last_undegraded":"2021-08-21T15:04:54.794997+0000","last_fullsized":"2021-08-21T15:04:54.794997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5410,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.794806+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:54.794806+0000","last_peered":"2021-08-21T15:04:54.794806+0000","last_clean":"2021-08-21T15:04:54.794806+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:54.794806+0000","last_undegraded":"2021-08-21T15:04:54.794806+0000","last_fullsized":"2021-08-21T15:04:54.794806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5119,"reported_epoch":38,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:20.654153+0000","last_change":"2021-08-21T15:04:41.725654+0000","last_active":"2021-08-21T15:05:20.654153+0000","last_peered":"2021-08-21T15:05:20.654153+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:20.654153+0000","last_undegraded":"2021-08-21T15:05:20.654153+0000","last_fullsized":"2021-08-21T15:04:01.649575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":454,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":3153}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4733,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.806715+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:04:55.806715+0000","last_peered":"2021-08-21T15:04:55.806715+0000","last_clean":"2021-08-21T15:04:55.806715+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:04:55.806715+0000","last_undegraded":"2021-08-21T15:04:55.806715+0000","last_fullsized":"2021-08-21T15:04:55.806715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2135,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":13,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018898,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76800,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":22078,"kb_avail":94295040,"statfs":{"total":96636764160,"available":96558120960,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22608840},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.251},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.218}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.22900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.254}]}]},{"osd":1,"up_from":22,"seq":94489280542,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.28999999999999998}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.30599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:26.732 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:27.012 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:27.013 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:27.023 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2021-08-21T15:05:26.478107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2186,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334040,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":110141,"kb_avail":282781480,"statfs":{"total":289910292480,"available":289568235520,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112785296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.126347"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5249,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.796157+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:55.796157+0000","last_peered":"2021-08-21T15:04:55.796157+0000","last_clean":"2021-08-21T15:04:55.796157+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:55.796157+0000","last_undegraded":"2021-08-21T15:04:55.796157+0000","last_fullsized":"2021-08-21T15:04:55.796157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4536,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.795839+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:55.795839+0000","last_peered":"2021-08-21T15:04:55.795839+0000","last_clean":"2021-08-21T15:04:55.795839+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:55.795839+0000","last_undegraded":"2021-08-21T15:04:55.795839+0000","last_fullsized":"2021-08-21T15:04:55.795839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5411,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.795774+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:55.795774+0000","last_peered":"2021-08-21T15:04:55.795774+0000","last_clean":"2021-08-21T15:04:55.795774+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:55.795774+0000","last_undegraded":"2021-08-21T15:04:55.795774+0000","last_fullsized":"2021-08-21T15:04:55.795774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5224,"reported_epoch":39,"state":"peering","last_fresh":"2021-08-21T15:05:25.472642+0000","last_change":"2021-08-21T15:05:25.472887+0000","last_active":"2021-08-21T15:05:25.472642+0000","last_peered":"2021-08-21T15:05:25.121498+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:25.472642+0000","last_undegraded":"2021-08-21T15:05:25.472642+0000","last_fullsized":"2021-08-21T15:05:25.472642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4734,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:05:09.500562+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:09.500562+0000","last_peered":"2021-08-21T15:05:09.500562+0000","last_clean":"2021-08-21T15:05:09.500562+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:09.500562+0000","last_undegraded":"2021-08-21T15:05:09.500562+0000","last_fullsized":"2021-08-21T15:05:09.500562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2186,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018899,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76864,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":22142,"kb_avail":94294976,"statfs":{"total":96636764160,"available":96558055424,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22674376},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.251},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.218}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.22900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.17399999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.184},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.223}]}]},{"osd":1,"up_from":22,"seq":94489280543,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:27.024 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:27.374 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:27.374 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1060/55734 objects degraded (1.902%), 2 pgs degraded, 2 pgs undersized","count":4},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":193,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":40,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":5},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":2},{"state_name":"peering","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342056960,"bytes_avail":289568235520,"bytes_total":289910292480,"inactive_pgs_ratio":0.125,"degraded_objects":1060,"degraded_total":55734,"degraded_ratio":0.01901891125704238,"recovering_objects_per_sec":10,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":110,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:27.387 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:27.388 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:27.669 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:27.673 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:27.684 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2021-08-21T15:05:26.478107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2186,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334040,"kb_used_data":223872,"kb_used_omap":2,"kb_used_meta":110141,"kb_avail":282781480,"statfs":{"total":289910292480,"available":289568235520,"internally_reserved":0,"allocated":229244928,"data_stored":228594189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112785296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.126347"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5249,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.796157+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:55.796157+0000","last_peered":"2021-08-21T15:04:55.796157+0000","last_clean":"2021-08-21T15:04:55.796157+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:55.796157+0000","last_undegraded":"2021-08-21T15:04:55.796157+0000","last_fullsized":"2021-08-21T15:04:55.796157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4536,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.795839+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:55.795839+0000","last_peered":"2021-08-21T15:04:55.795839+0000","last_clean":"2021-08-21T15:04:55.795839+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:55.795839+0000","last_undegraded":"2021-08-21T15:04:55.795839+0000","last_fullsized":"2021-08-21T15:04:55.795839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4577,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796699+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:04:54.796699+0000","last_peered":"2021-08-21T15:04:54.796699+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:04:54.796699+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5411,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.795774+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:55.795774+0000","last_peered":"2021-08-21T15:04:55.795774+0000","last_clean":"2021-08-21T15:04:55.795774+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:55.795774+0000","last_undegraded":"2021-08-21T15:04:55.795774+0000","last_fullsized":"2021-08-21T15:04:55.795774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5194,"reported_epoch":37,"state":"active+clean","last_fresh":"2021-08-21T15:04:54.796680+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:04:54.796680+0000","last_peered":"2021-08-21T15:04:54.796680+0000","last_clean":"2021-08-21T15:04:54.796680+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:04:54.796680+0000","last_undegraded":"2021-08-21T15:04:54.796680+0000","last_fullsized":"2021-08-21T15:04:54.796680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5224,"reported_epoch":39,"state":"peering","last_fresh":"2021-08-21T15:05:25.472642+0000","last_change":"2021-08-21T15:05:25.472887+0000","last_active":"2021-08-21T15:05:25.472642+0000","last_peered":"2021-08-21T15:05:25.121498+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:25.472642+0000","last_undegraded":"2021-08-21T15:05:25.472642+0000","last_fullsized":"2021-08-21T15:05:25.472642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4734,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:05:09.500562+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:09.500562+0000","last_peered":"2021-08-21T15:05:09.500562+0000","last_clean":"2021-08-21T15:05:09.500562+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:09.500562+0000","last_undegraded":"2021-08-21T15:05:09.500562+0000","last_fullsized":"2021-08-21T15:05:09.500562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4715,"reported_epoch":37,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:04:54.796790+0000","last_change":"2021-08-21T15:04:02.002607+0000","last_active":"2021-08-21T15:04:54.796790+0000","last_peered":"2021-08-21T15:04:54.796790+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:04:54.796790+0000","last_undegraded":"2021-08-21T15:04:01.659932+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1060,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2186,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018899,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76864,"kb_used_data":54712,"kb_used_omap":1,"kb_used_meta":22142,"kb_avail":94294976,"statfs":{"total":96636764160,"available":96558055424,"internally_reserved":0,"allocated":56025088,"data_stored":55808175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22674376},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.251},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.218}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.22900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132220,"kb_used_data":85748,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239620,"statfs":{"total":96636764160,"available":96501370880,"internally_reserved":0,"allocated":87805952,"data_stored":87589039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.17399999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.184},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.223}]}]},{"osd":1,"up_from":22,"seq":94489280543,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:30.690 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:30.984 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:30.986 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:31.006 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2021-08-21T15:05:30.353727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2214,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334200,"kb_used_data":223904,"kb_used_omap":2,"kb_used_meta":110269,"kb_avail":282781320,"statfs":{"total":289910292480,"available":289568071680,"internally_reserved":0,"allocated":229277696,"data_stored":228605431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112916368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001336"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5249,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.796157+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:55.796157+0000","last_peered":"2021-08-21T15:04:55.796157+0000","last_clean":"2021-08-21T15:04:55.796157+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:55.796157+0000","last_undegraded":"2021-08-21T15:04:55.796157+0000","last_fullsized":"2021-08-21T15:04:55.796157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4536,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.795839+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:55.795839+0000","last_peered":"2021-08-21T15:04:55.795839+0000","last_clean":"2021-08-21T15:04:55.795839+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:55.795839+0000","last_undegraded":"2021-08-21T15:04:55.795839+0000","last_fullsized":"2021-08-21T15:04:55.795839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5411,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.795774+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:55.795774+0000","last_peered":"2021-08-21T15:04:55.795774+0000","last_clean":"2021-08-21T15:04:55.795774+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:55.795774+0000","last_undegraded":"2021-08-21T15:04:55.795774+0000","last_fullsized":"2021-08-21T15:04:55.795774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5224,"reported_epoch":39,"state":"peering","last_fresh":"2021-08-21T15:05:25.472642+0000","last_change":"2021-08-21T15:05:25.472887+0000","last_active":"2021-08-21T15:05:25.472642+0000","last_peered":"2021-08-21T15:05:25.121498+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:25.472642+0000","last_undegraded":"2021-08-21T15:05:25.472642+0000","last_fullsized":"2021-08-21T15:05:25.472642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4734,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:05:09.500562+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:09.500562+0000","last_peered":"2021-08-21T15:05:09.500562+0000","last_clean":"2021-08-21T15:05:09.500562+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:09.500562+0000","last_undegraded":"2021-08-21T15:05:09.500562+0000","last_fullsized":"2021-08-21T15:05:09.500562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4774,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:27.444802+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:27.444802+0000","last_peered":"2021-08-21T15:05:27.444802+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:27.444802+0000","last_undegraded":"2021-08-21T15:05:27.444802+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2214,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77008,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22270,"kb_avail":94294832,"statfs":{"total":96636764160,"available":96557907968,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22805448},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.23400000000000001}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.193},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.21099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738410,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20399999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.223},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.19400000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280543,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:31.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:31.369 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:31.370 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 507/55734 objects degraded (0.910%), 1 pg degraded, 2 pgs undersized","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":197,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":40,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":5},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342220800,"bytes_avail":289568071680,"bytes_total":289910292480,"inactive_pgs_ratio":0.125,"degraded_objects":507,"degraded_total":55734,"degraded_ratio":0.0090967811389815918,"recovering_objects_per_sec":9,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:31.386 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:31.386 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:31.668 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:31.670 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:31.681 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2021-08-21T15:05:30.353727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2214,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334200,"kb_used_data":223904,"kb_used_omap":2,"kb_used_meta":110269,"kb_avail":282781320,"statfs":{"total":289910292480,"available":289568071680,"internally_reserved":0,"allocated":229277696,"data_stored":228605431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112916368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001336"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5249,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.796157+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:04:55.796157+0000","last_peered":"2021-08-21T15:04:55.796157+0000","last_clean":"2021-08-21T15:04:55.796157+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:04:55.796157+0000","last_undegraded":"2021-08-21T15:04:55.796157+0000","last_fullsized":"2021-08-21T15:04:55.796157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4536,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.795839+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:04:55.795839+0000","last_peered":"2021-08-21T15:04:55.795839+0000","last_clean":"2021-08-21T15:04:55.795839+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:04:55.795839+0000","last_undegraded":"2021-08-21T15:04:55.795839+0000","last_fullsized":"2021-08-21T15:04:55.795839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5411,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:04:55.795774+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:04:55.795774+0000","last_peered":"2021-08-21T15:04:55.795774+0000","last_clean":"2021-08-21T15:04:55.795774+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:04:55.795774+0000","last_undegraded":"2021-08-21T15:04:55.795774+0000","last_fullsized":"2021-08-21T15:04:55.795774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5224,"reported_epoch":39,"state":"peering","last_fresh":"2021-08-21T15:05:25.472642+0000","last_change":"2021-08-21T15:05:25.472887+0000","last_active":"2021-08-21T15:05:25.472642+0000","last_peered":"2021-08-21T15:05:25.121498+0000","last_clean":"2021-08-21T15:02:55.798617+0000","last_became_active":"2021-08-21T15:04:02.015907+0000","last_became_peered":"2021-08-21T15:04:02.015907+0000","last_unstale":"2021-08-21T15:05:25.472642+0000","last_undegraded":"2021-08-21T15:05:25.472642+0000","last_fullsized":"2021-08-21T15:05:25.472642+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4734,"reported_epoch":38,"state":"active+clean","last_fresh":"2021-08-21T15:05:09.500562+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:09.500562+0000","last_peered":"2021-08-21T15:05:09.500562+0000","last_clean":"2021-08-21T15:05:09.500562+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:09.500562+0000","last_undegraded":"2021-08-21T15:05:09.500562+0000","last_fullsized":"2021-08-21T15:05:09.500562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4774,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:27.444802+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:27.444802+0000","last_peered":"2021-08-21T15:05:27.444802+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:27.444802+0000","last_undegraded":"2021-08-21T15:05:27.444802+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2214,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77008,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22270,"kb_avail":94294832,"statfs":{"total":96636764160,"available":96557907968,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22805448},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.23400000000000001}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.193},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.21099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738410,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20399999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.223},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.19400000000000001}]}]},{"osd":1,"up_from":22,"seq":94489280543,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124956,"kb_used_data":83412,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246884,"statfs":{"total":96636764160,"available":96508809216,"internally_reserved":0,"allocated":85413888,"data_stored":85196975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:34.683 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:34.968 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:34.971 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:34.981 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2021-08-21T15:05:34.354383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2272,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334280,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110333,"kb_avail":282781240,"statfs":{"total":289910292480,"available":289567989760,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112981904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.882848"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4890,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:32.428492+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:32.428492+0000","last_peered":"2021-08-21T15:05:32.428492+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:32.428492+0000","last_undegraded":"2021-08-21T15:05:32.428492+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2272,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018901,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77072,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22334,"kb_avail":94294768,"statfs":{"total":96636764160,"available":96557842432,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22870984},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.20799999999999999}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.251},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.27200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738411,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.253}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.21199999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280544,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.222}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.214},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.28199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:34.982 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:35.331 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:35.331 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 507/55734 objects degraded (0.910%), 1 pg degraded, 2 pgs undersized","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":201,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":40,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":6},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342302720,"bytes_avail":289567989760,"bytes_total":289910292480,"degraded_objects":507,"degraded_total":55734,"degraded_ratio":0.0090967811389815918,"recovering_objects_per_sec":15,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":137,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:35.344 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:35.344 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:35.635 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:35.636 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2021-08-21T15:05:34.354383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2272,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334280,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110333,"kb_avail":282781240,"statfs":{"total":289910292480,"available":289567989760,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112981904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.882848"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":4890,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:32.428492+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:32.428492+0000","last_peered":"2021-08-21T15:05:32.428492+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:32.428492+0000","last_undegraded":"2021-08-21T15:05:32.428492+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2272,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018901,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77072,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22334,"kb_avail":94294768,"statfs":{"total":96636764160,"available":96557842432,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22870984},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.20799999999999999}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.251},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.27200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738411,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.253}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.21199999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280544,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.222}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.214},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.28199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:38.649 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:38.936 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:38.937 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:38.946 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2021-08-21T15:05:38.355028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2330,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334280,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110333,"kb_avail":282781240,"statfs":{"total":289910292480,"available":289567989760,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112981904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.876920"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":5006,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:37.412758+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:37.412758+0000","last_peered":"2021-08-21T15:05:37.412758+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:37.412758+0000","last_undegraded":"2021-08-21T15:05:37.412758+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2330,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018901,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77072,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22334,"kb_avail":94294768,"statfs":{"total":96636764160,"available":96557842432,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22870984},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.20799999999999999}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.251},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.27200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.182},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.223}]}]},{"osd":1,"up_from":22,"seq":94489280545,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.188},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.26400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:38.948 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:39.291 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:39.292 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 507/55734 objects degraded (0.910%), 1 pg degraded, 2 pgs undersized","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":205,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":40,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":6},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342302720,"bytes_avail":289567989760,"bytes_total":289910292480,"degraded_objects":507,"degraded_total":55734,"degraded_ratio":0.0090967811389815918,"recovering_objects_per_sec":12,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:39.304 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:39.305 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:39.599 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:39.600 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:39.611 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2021-08-21T15:05:38.355028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2330,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334280,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110333,"kb_avail":282781240,"statfs":{"total":289910292480,"available":289567989760,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":112981904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-553,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.876920"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":5006,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:37.412758+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:37.412758+0000","last_peered":"2021-08-21T15:05:37.412758+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:37.412758+0000","last_undegraded":"2021-08-21T15:05:37.412758+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2330,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018901,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77072,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22334,"kb_avail":94294768,"statfs":{"total":96636764160,"available":96557842432,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22870984},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.20799999999999999}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.251},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.27200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.182},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.223}]}]},{"osd":1,"up_from":22,"seq":94489280545,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.188},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.26400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:42.618 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:42.940 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:42.955 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2021-08-21T15:05:42.355735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2330,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334344,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110397,"kb_avail":282781176,"statfs":{"total":289910292480,"available":289567924224,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":113047440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002007"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":5006,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:37.412758+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:37.412758+0000","last_peered":"2021-08-21T15:05:37.412758+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:37.412758+0000","last_undegraded":"2021-08-21T15:05:37.412758+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2330,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018902,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77136,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22398,"kb_avail":94294704,"statfs":{"total":96636764160,"available":96557776896,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22936520},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.224}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.246},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.23200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.182},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.223}]}]},{"osd":1,"up_from":22,"seq":94489280546,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.314}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:42.956 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:43.351 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:43.352 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 507/55734 objects degraded (0.910%), 1 pg degraded, 2 pgs undersized","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":209,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":40,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":6},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342368256,"bytes_avail":289567924224,"bytes_total":289910292480,"degraded_objects":507,"degraded_total":55734,"degraded_ratio":0.0090967811389815918,"recovering_objects_per_sec":9,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:43.365 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:43.366 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:43.673 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:43.676 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2021-08-21T15:05:42.355735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2330,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334344,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110397,"kb_avail":282781176,"statfs":{"total":289910292480,"available":289567924224,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":113047440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002007"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":5006,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:37.412758+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:37.412758+0000","last_peered":"2021-08-21T15:05:37.412758+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:37.412758+0000","last_undegraded":"2021-08-21T15:05:37.412758+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":144,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2330,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018902,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77136,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22398,"kb_avail":94294704,"statfs":{"total":96636764160,"available":96557776896,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":22936520},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.224}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.246},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.23200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.182},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.20699999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.223}]}]},{"osd":1,"up_from":22,"seq":94489280546,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.314}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:46.679 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:46.984 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:46.985 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:46.986 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2021-08-21T15:05:46.356378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2388,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334408,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110461,"kb_avail":282781112,"statfs":{"total":289910292480,"available":289567858688,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":113112976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001995"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":5122,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:42.397003+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:42.397003+0000","last_peered":"2021-08-21T15:05:42.397003+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:42.397003+0000","last_undegraded":"2021-08-21T15:05:42.397003+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2388,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77200,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22462,"kb_avail":94294640,"statfs":{"total":96636764160,"available":96557711360,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":23002056},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.19700000000000001}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.22}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.247},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.17499999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280547,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.19},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.19900000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:46.987 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:47.334 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:47.335 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 507/55734 objects degraded (0.910%), 1 pg degraded, 2 pgs undersized","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":213,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":40,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":6},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342433792,"bytes_avail":289567858688,"bytes_total":289910292480,"degraded_objects":507,"degraded_total":55734,"degraded_ratio":0.0090967811389815918,"recovering_objects_per_sec":9,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:47.367 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:47.368 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:47.664 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:47.665 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:47.676 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2021-08-21T15:05:46.356378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2388,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334408,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110461,"kb_avail":282781112,"statfs":{"total":289910292480,"available":289567858688,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":113112976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001995"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":5122,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:42.397003+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:42.397003+0000","last_peered":"2021-08-21T15:05:42.397003+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:42.397003+0000","last_undegraded":"2021-08-21T15:05:42.397003+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2388,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77200,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22462,"kb_avail":94294640,"statfs":{"total":96636764160,"available":96557711360,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":23002056},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.19700000000000001}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.22}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.247},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.17499999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280547,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.19},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.19900000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:50.678 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:50.965 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:50.967 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:50.978 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2021-08-21T15:05:50.357017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2447,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334472,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110525,"kb_avail":282781048,"statfs":{"total":289910292480,"available":289567793152,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":113178512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001989"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":5240,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:47.467898+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:47.467898+0000","last_peered":"2021-08-21T15:05:47.467898+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:47.467898+0000","last_undegraded":"2021-08-21T15:05:47.467898+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":261,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2447,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77264,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22526,"kb_avail":94294576,"statfs":{"total":96636764160,"available":96557645824,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":23067592},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.20999999999999999}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.221}]}]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.27600000000000002}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.30399999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280547,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.19},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.19900000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:50.979 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2021-08-21T15:05:51.322 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:51.322 INFO:teuthology.orchestra.run.smithi173.stdout:{"fsid":"90c992ca-066c-4cb6-b72f-9d34f4a3b9cc","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 507/55734 objects degraded (0.910%), 1 pg degraded, 2 pgs undersized","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":217,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":40,"num_osds":3,"num_up_osds":3,"osd_up_since":1629558239,"num_in_osds":3,"osd_in_since":1629558134,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":6},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":8,"num_pools":1,"num_objects":27867,"data_bytes":114143232,"bytes_used":342499328,"bytes_avail":289567793152,"bytes_total":289910292480,"degraded_objects":507,"degraded_total":55734,"degraded_ratio":0.0090967811389815918,"recovering_objects_per_sec":9,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":117,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2021-08-21T15:05:00.348779+0000","services":{}},"progress_events":{}} 2021-08-21T15:05:51.335 INFO:tasks.osd_recovery.ceph_manager:making progress, resetting timeout 2021-08-21T15:05:51.336 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:51.621 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-08-21T15:05:51.622 INFO:teuthology.orchestra.run.smithi173.stderr:dumped all 2021-08-21T15:05:51.634 INFO:teuthology.orchestra.run.smithi173.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2021-08-21T15:05:50.357017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2447,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":334472,"kb_used_data":223920,"kb_used_omap":2,"kb_used_meta":110525,"kb_avail":282781048,"statfs":{"total":289910292480,"available":289567793152,"internally_reserved":0,"allocated":229294080,"data_stored":228611052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2160,"internal_metadata":113178512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001989"},"pg_stats":[{"pgid":"1.7","version":"28'4267","reported_seq":5250,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471755+0000","last_change":"2021-08-21T15:04:42.785777+0000","last_active":"2021-08-21T15:05:25.471755+0000","last_peered":"2021-08-21T15:05:25.471755+0000","last_clean":"2021-08-21T15:05:25.471755+0000","last_became_active":"2021-08-21T15:04:42.776357+0000","last_became_peered":"2021-08-21T15:04:42.776357+0000","last_unstale":"2021-08-21T15:05:25.471755+0000","last_undegraded":"2021-08-21T15:05:25.471755+0000","last_fullsized":"2021-08-21T15:05:25.471755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4267,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13742080,"num_objects":3355,"num_object_clones":0,"num_object_copies":6710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3355,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4267,"num_write_kb":15244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":24576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"28'4491","reported_seq":4537,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471899+0000","last_change":"2021-08-21T15:04:37.492031+0000","last_active":"2021-08-21T15:05:25.471899+0000","last_peered":"2021-08-21T15:05:25.471899+0000","last_clean":"2021-08-21T15:05:25.471899+0000","last_became_active":"2021-08-21T15:04:28.737483+0000","last_became_peered":"2021-08-21T15:04:28.737483+0000","last_unstale":"2021-08-21T15:05:25.471899+0000","last_undegraded":"2021-08-21T15:05:25.471899+0000","last_fullsized":"2021-08-21T15:05:25.471899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4491,"ondisk_log_size":4491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14217216,"num_objects":3471,"num_object_clones":0,"num_object_copies":6942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3471,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4491,"num_write_kb":15924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":307,"num_bytes_recovered":1257472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"28'4538","reported_seq":4579,"reported_epoch":39,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2021-08-21T15:05:25.472387+0000","last_change":"2021-08-21T15:04:02.008566+0000","last_active":"2021-08-21T15:05:25.472387+0000","last_peered":"2021-08-21T15:05:25.472387+0000","last_clean":"2021-08-21T15:02:57.854003+0000","last_became_active":"2021-08-21T15:04:01.998618+0000","last_became_peered":"2021-08-21T15:04:01.998618+0000","last_unstale":"2021-08-21T15:05:25.472387+0000","last_undegraded":"2021-08-21T15:04:01.657568+0000","last_fullsized":"2021-08-21T15:04:01.647658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4538,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14434304,"num_objects":3524,"num_object_clones":0,"num_object_copies":7048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3524,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4538,"num_write_kb":16124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3524}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"28'4747","reported_seq":5412,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471667+0000","last_change":"2021-08-21T15:03:49.492550+0000","last_active":"2021-08-21T15:05:25.471667+0000","last_peered":"2021-08-21T15:05:25.471667+0000","last_clean":"2021-08-21T15:05:25.471667+0000","last_became_active":"2021-08-21T15:03:37.597788+0000","last_became_peered":"2021-08-21T15:03:37.597788+0000","last_unstale":"2021-08-21T15:05:25.471667+0000","last_undegraded":"2021-08-21T15:05:25.471667+0000","last_fullsized":"2021-08-21T15:05:25.471667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4747,"ondisk_log_size":4747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15028224,"num_objects":3669,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3669,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4747,"num_write_kb":16832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"28'4569","reported_seq":5196,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.472306+0000","last_change":"2021-08-21T15:04:01.667924+0000","last_active":"2021-08-21T15:05:25.472306+0000","last_peered":"2021-08-21T15:05:25.472306+0000","last_clean":"2021-08-21T15:05:25.472306+0000","last_became_active":"2021-08-21T15:04:01.653634+0000","last_became_peered":"2021-08-21T15:04:01.653634+0000","last_unstale":"2021-08-21T15:05:25.472306+0000","last_undegraded":"2021-08-21T15:05:25.472306+0000","last_fullsized":"2021-08-21T15:05:25.472306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4569,"ondisk_log_size":4569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14585856,"num_objects":3561,"num_object_clones":0,"num_object_copies":7122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3561,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4569,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":1171456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"28'4163","reported_seq":5232,"reported_epoch":40,"state":"active+clean","last_fresh":"2021-08-21T15:05:26.489721+0000","last_change":"2021-08-21T15:05:26.489721+0000","last_active":"2021-08-21T15:05:26.489721+0000","last_peered":"2021-08-21T15:05:26.489721+0000","last_clean":"2021-08-21T15:05:26.489721+0000","last_became_active":"2021-08-21T15:05:26.480976+0000","last_became_peered":"2021-08-21T15:05:26.480976+0000","last_unstale":"2021-08-21T15:05:26.489721+0000","last_undegraded":"2021-08-21T15:05:26.489721+0000","last_fullsized":"2021-08-21T15:05:26.489721+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4163,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12914688,"num_objects":3153,"num_object_clones":0,"num_object_copies":6306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3153,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4163,"num_write_kb":14632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":505,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"28'4690","reported_seq":4735,"reported_epoch":39,"state":"active+clean","last_fresh":"2021-08-21T15:05:25.471680+0000","last_change":"2021-08-21T15:05:09.500562+0000","last_active":"2021-08-21T15:05:25.471680+0000","last_peered":"2021-08-21T15:05:25.471680+0000","last_clean":"2021-08-21T15:05:25.471680+0000","last_became_active":"2021-08-21T15:04:55.798722+0000","last_became_peered":"2021-08-21T15:04:55.798722+0000","last_unstale":"2021-08-21T15:05:25.471680+0000","last_undegraded":"2021-08-21T15:05:25.471680+0000","last_fullsized":"2021-08-21T15:05:25.471680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4690,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14606336,"num_objects":3566,"num_object_clones":0,"num_object_copies":7132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4690,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":1302528,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"28'4675","reported_seq":5240,"reported_epoch":40,"state":"active+recovering+undersized+remapped","last_fresh":"2021-08-21T15:05:47.467898+0000","last_change":"2021-08-21T15:05:25.124334+0000","last_active":"2021-08-21T15:05:47.467898+0000","last_peered":"2021-08-21T15:05:47.467898+0000","last_clean":"2021-08-21T15:02:57.835487+0000","last_became_active":"2021-08-21T15:04:01.990346+0000","last_became_peered":"2021-08-21T15:04:01.990346+0000","last_unstale":"2021-08-21T15:05:47.467898+0000","last_undegraded":"2021-08-21T15:05:47.467898+0000","last_fullsized":"2021-08-21T15:04:01.648183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-08-21T15:02:22.461993+0000","last_clean_scrub_stamp":"2021-08-21T15:02:22.461993+0000","log_size":4675,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14614528,"num_objects":3568,"num_object_clones":0,"num_object_copies":7136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3568,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4675,"num_write_kb":16482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":261,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3568}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":114143232,"num_objects":27867,"num_object_clones":0,"num_object_copies":55734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":507,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27867,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":36140,"num_write_kb":128010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2447,"num_bytes_recovered":5017600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":228286464,"data_stored":228286464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36140,"ondisk_log_size":36140,"up":16,"acting":14,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":30,"seq":128849018904,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77264,"kb_used_data":54728,"kb_used_omap":1,"kb_used_meta":22526,"kb_avail":94294576,"statfs":{"total":96636764160,"available":96557645824,"internally_reserved":0,"allocated":56041472,"data_stored":55813796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":23067592},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.222,"15min":0.222},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.308,"5min":0.308,"15min":0.308},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"last":0.20999999999999999}]},{"osd":1,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.221}]}]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132236,"kb_used_data":85764,"kb_used_omap":0,"kb_used_meta":46464,"kb_avail":94239604,"statfs":{"total":96636764160,"available":96501354496,"internally_reserved":0,"allocated":87822336,"data_stored":87594660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":47579136},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20399999999999999,"15min":0.20599999999999999},"min":{"1min":0.157,"5min":0.156,"15min":0.156},"max":{"1min":0.23400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.20999999999999999,"5min":0.20300000000000001,"15min":0.20200000000000001},"min":{"1min":0.19,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.23000000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"last":0.27600000000000002}]},{"osd":2,"last update":"Sat Aug 21 15:05:00 2021","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.30399999999999999}]}]},{"osd":1,"up_from":22,"seq":94489280547,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124972,"kb_used_data":83428,"kb_used_omap":1,"kb_used_meta":41534,"kb_avail":94246868,"statfs":{"total":96636764160,"available":96508792832,"internally_reserved":0,"allocated":85430272,"data_stored":85202596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":42531784},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 21 15:05:10 2021","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.48499999999999999,"15min":0.53100000000000003},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":0.39100000000000001,"5min":4.4530000000000003,"15min":4.4530000000000003},"last":0.19},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.186,"5min":0.185,"15min":0.185},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.19900000000000001}]},{"osd":2,"last update":"Sat Aug 21 15:05:01 2021","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.373,"5min":0.373,"15min":0.373},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.251,"15min":0.251},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"last":0.222}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87486464,"data_stored":87486464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":85094400,"data_stored":85094400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55705600,"data_stored":55705600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-08-21T15:05:54.636 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-08-21T15:05:54.749 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-08-21T15:05:54.750 DEBUG:teuthology.task.console_log:Killing console logger for smithi173 2021-08-21T15:05:54.751 DEBUG:teuthology.exit:Finished running handlers